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PRIPAO 

The  risk  and  uncertainty  inherent  in  weapon  system  development  pose 
a  significant  challenge  to  cost  estimators.  Such  uncertainty  suggests 
that  a  goal  of  absolute  precision  in  cost  estimation  is  impractical-- 
some  error  must  be  accepted.  A  systematic  bias  in  cost  estimation, 
however,  would  present  a  problem  in  that  it  can  distort  resource 
allocation  decisions  and  undermine  the  rationale  for  those  decisions. 
This  problem  is  of  particular  concern  in  an  environment  of  decreasing 
budgets . 

The  difference  between  estimated  and  actual  costs  is  often  referred 
to  as  cost  growth.  This  research  attempts  to  gain  insight  into  both  the 
magnitude  of  the  weapon  system  cost  growth  problem  and  the  factors  that 
affect  the  cost  growth  phenomena.  The  results  of  this  study  should  be 
of  interest  to  policymakers  and  analysts  concerned  with  the  quality  of 
DoD  cost  estimation  and  the  efficiency  of  weapon  system  acquisition  in 
general . 

This  study  was  sponson  i  by  the  Office  of  the  Assistant  Secretary 
of  the  Air  Force  for  Financial  Management  (Cost  and  Economics)  and  was 
performed  in  the  Resource  Management  and  System  Acquisition  Program  of 
Project  AIR  FORCE,  a  federally  funded  research  and  development  center  at 
RAND. 
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Cost  growth  in  weapon  system  development,  one  result  of  the 
inherent  risk  of  developing  advanced  systems,  has  been  a  prevalent 
problem  for  many  years.  A  systematic  bias  in  cost  estimates  can 
undermine  the  basis  of  resource  allocation  decisions,  an  important 
problem  in  a  tight  budget  environment.  Currently  DoD  is  in  this 
situation . 

This  exploratory  research  attempts  to  gain  new  insight  into  this 
old  acquisition  issue.  In  particular,  our  objectives  were  to: 

1.  Quantify  the  magnitude  of  cost  growth  in  weapon  systems 

2.  Identify  factois  effecting  cost  growth 

A  better  understanding  of  the  scope  of  the  cost  growth  problem  would 
provide  decisionmakers  with  an  improved  basis  for  mitigating  cost 
growth.  Insight  into  the  drivers  of  cost  growth  might  suggest  policy 
alternatives  appropriate  to  the  goal  of  mitigating  cost  growth.  This 
research  uses  a  database  composed  of  197  major  weapon  systems  reporting 
through  the  Selected  Acquisition  Report  (SAR)  process  as  of  December 
1990  to  address  these  issues.  While  we  have  quantified  the  magnitude  of 
weapon  system  cost  growth  along  a  number  of  dimensions,  we  could  not 
definitively  account  for  the  observed  cost  growth  patterns.  Thus,  no 
"silver  bullet"  policy  option  is  available  foi’  mitigating  cost  grov.th. 

MBA80RZN0  COST  GROWTH 

Cost  growth  can  he  measured  in  several  different  ways,  each 
yielding  a  somewhat  different  picture  of  the  magnitude  of  the  problem. 
Since  a  basic  objective  of  this  research  was  to  gain  insight  into  the 
factors  affecting  cost  growth  of  on-going  programs,  we  adjusted  the  data 
to  account  for  those  factors  not  reasonably  attributable  to  cost 
estimators  at  the  time  an  estimate  is  made.  Hence  we  have  made  all 
calculation  in  teima  of  program  baseyear  dollars  to  remove  the  effects 
of  inflation,  and  we  have  removed  the  effects  of  quantity  changes  by 
adjusting  ail  cofjh  variance  to  the  baseline  quantity.  Since  three 
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different  baselines  are  possible  for  each  program--planning, 
development,  and  product  ion- -each  associated  with  a  particular  Milestone 
in  the  acquisition  process,  we  have  handled  each  baseline  separately. 
Most  of  the  data  we  present  are  referenced  to  the  development  estimate 
(DE)  baseline  made  at  the  start  of  engineering  and  manufacturing 
development  (EMD) ;  the  database  contains  150  programs  with  a  DE 
baseline. 

The  two  factors  that  have  the  greatest  effect  on  total  program  cost 
growth  are  program  size  and  maturity.  Smaller  programs  tend  to  have 
higher  coat  growth,  in  part  because  dollar  changes  are  more  visible  in 
percentage  terms  in  smaller  programs  but  perhaps  also  because  smaller 
programs  may  receive  less  high  level  management  attention.  Older 
programs  tend  to  have  higher  cost  growth  because  of  the  accumulation  of 
problems  and  changes  (e.g.,  performance  improvements)  over  time.  Both 
of  these  effects  can  dominate  any  other  factor  affecting  cost  growth, 
in  this  analysis,  we  have  nsod  weighted  a'^erage  cost  growth  figures  when 
ma)<ing  comparisons  between  groups  of  programs,  thus  adjusting  for 
program  size  (measured  as  the  total  program  baseline  costs) . 
Additionally,  we  have  used  only  programs  that  have  progressed  three  or 
more  yeaics  past  EMD  start,  a  cut  oft  point  that  reosnnalily  corrc.sponci'^ 
with  the  availability  of  good  quality  information,  Currently  lilfi 
programs  are  three  or  more  years  past  EMD  start  and  havi?  a  DE  bnncLinc. 

SCOPE  OF  THE  PROBLEM 

An  an  usil',  Inuit.  i  tiu  gcja  1  ,  wo  migfit  dctiiro  lluil.,  on  .ivortuTo,  mu  coni 
I’iii'.  i iiuit.cn.  at  e  nnbiiisi.'d  with  a  moan  coiii  yruwl.  h  of  zero  and  tliat  act.'U i  i.n..'y 
Lrnpiovos  over  time  as  a  funct.ion  of  improved  information. 

Unf ortunatc'iy ,  our  re.suU.s  indicate  tiial;  co.st  eutimatOLi  in  tact-  ,iiu 
nyatemat  ica  1  ,ly  binned  toward  underestimation.  Weighted  average  l.ot.ai 
pioyiam  cunt  yrowtdi  in  alioiit  iiO  percent  at  both  tdie  planning  (Milontuiu' 
1)  and  development  (Milestone  2)  baselines,  falling  to  about  2  perctent; 
at,  the  ptoduct.ion  (Miiestotu'  la)  baseline.  However,  hen.'  very  liiyh 
vati,,itu.'e  iiround  t.lio.se  averages  redi’.c;c!-i  confiderice  in  t.iie  piodict  i '.'t? 
pc;W('r  i.il.  i.he  cocit  estimates.  Furttier,  the  distribution  of  t.i;e  data  in 
hiylily  .skewed  toward  cout  yi.owLti  il.houq*!  some  proyrams  ardiieve  iret;tt!r 
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than  estimated  cost  performance)  and  that  distribution  does  not  improve 
signif icariLly  over  time  as  better  quality  information  becomes  available. 

The  weighted  average  cost  growth  of  DE  baseline  line  programs  three 
or  more  years  past  EMD  start  (n=128)  as  of  December  1990  is  20  percent. 
The  Army  and  two  of  its  main  system  types,  vehicles  and  helicopters, 
tend  to  have  somewhat  higher  cost  growth,  explained  in  part  by  the 
somewhat  smaller  size  of  Army  programs  in  general.  The  average  cost 
growth  for  Air  Force  programs  is  slightly  higher  than  the  overall 
average,  while  the  average  across  Navy  programs  is  somewhat  lower. 

Perhaps  more  important,  little  improvement  has  occurred  over  time. 

A  myriad  of  acquisition  initiatives  has  been  introduced  over  the  last 
several  decades  in  an  attempt  to  control  cost  growth.  These  include  the 
1981  Carlucci  Initiatives,  the  Pac)<ard  Commission  recommendations,  and 
several  recent  PoD  regulations.  If  effective,  we  would  expect  to  see 
average  cost  growth  decline  in  response.  Our  results  indicate  that  cost 
growth  has  fluctuated  around  20  percent  since  the  mid  1960s.  The  lower 
cost  growth  for  programs  begun  in  the  1980s  is  due  almost  entirely  to 
the  effects  of  maturity.  We  fully  expect  that  these  programs  will  incur 
cost  growth  comparable  to  past  experience  as  they  mature. 

FACTORS  AFFQCTXNO  COST  OROWTH 

In  an  attempt  to  gain  insight  into  the  Eactor.s  affecting  cost 
qrowl'.h,  wc  examined  many  po.nsitile  explanatory  variables,  including  mac.To 
level  development  strategien,  schodulo  related  faotorn,  and  rr'anagemont: 
and  liiiilgi'i  cctin  i  deral- Lonn  .  We  louiid  Ic.'W  r,l  icniq  re  1  al.  1  oi  Mli  i  pit  l.liaL  would 
help  expl.di.ii  l.hu  yruwt.h  tjutcoineu  we  observed.  While  piogidiii 

longlii,  pi:  oqiarn  iij.xe,  maturity,  and  mod  1  f  i  r'al,  1  on  vernur  new  deveiopimentn 
ate  iri  rjni  1' i  tintil  .1  y  correlated  with  cont  growth,  no  iil:igle  factor  explains 
d  lart|e  fiort.lon  of  the  cjiiserved  variance  in  oor;t.  growth  outcomes.  The 
l■!ulJUtnll!  idl  i.noiUtun  I.  o  pu.  on  i.  utii  v.i  t  i  .it.  i  on  nufinentfi  t  liat  (hi-'Le  In  no 
dominant,  explanatory  variai>le.  Hence,  tl'ie  fjrobletn  of  font  nrowt'.h  doon 
not  hfive  .1  "nilver  bullel"  polii'y  i  I'nijonni.' . 

POLICY  IMPLICATIONS 

Oiii  M'Mi.’dich  r.iignent  n  no  nulmt ant  1  1 1  impiovemetil  in  avoi  acii'  coni 
niowili  ovi.i'  l.hi.-  Innl  U)  yi'.irn,  ili’igiii.e  the  1  inp  1  cnn.'iil  ,1 1  Ion  of  iieviual 
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initiatives  intended  to  mitigate  the  effects  of  cost  risk  and  the 
associated  cost  growth.  In  fact,  our  results  suggest  that  cost  growth 
has  remained  about  20  percent  over  this  time  period.  Of  interest  is 
that  this  result  is  somewhat  better  than  the  cost  performance  in  many 
large  civilian  projects,  such  as  energy  and  chemical  process  plants. 

Nonetheless,  rather  than  suggest  that  we  have  reached  the  limits  of 
our  estimating  ability,  the  apparent  consistency  in  cost  growth  could  be 
explained  in  terms  of  incomplete  or  incorrect  implementation  of  the 
various  cost  control  and  budgeting  initiatives,  due  to  strong 
institutional  barriers.  We  have  not  yet  fully  examined  an  important  set 
of  potential  explanatory  variables--institutional  and  incentive 
structure  factors--that  may  be  fundamental  drivers  of  cost  growth.  Part 
of  the  intent  of  some  of  the  recent  cost  and  acquisition  management 
initiatives  have  been  oriented  toward  changing  such  structures.  Full 
and  honest  implementation  of  existing  regulations  might  improve  the 
situation.  Of  course,  major  changes  probably  would  be  required  in  the 
institutional  structure  and  incentive  system  of  the  current  acquisition 
process . 

The  inability  of  any  single  factor  to  explain  large  portions  of 
observed  cost  has  important  policy  implications.  It  suggests  that  any 
policy  solution  of  necessity  will  be  complex,  incorporating  all  aspects 
of  the  acquisition  process  and  requiring  changes  in  behavior  in  all 
responsible  parties,  from  the  system  program  office  through  Congress. 
Further,  inflation  is  notoriously  difficult  to  estimate  accurately,  cind 
quantity  r:hanqen  may  be  nccessarv’  because  of  changes  in  tfie  budget 
environment  or  threat ---factors  well  beyond  the  control  of  program 
management.  Additionally,  the  very  large  uncertainty  inherent  in 
developing  advanced  systems  suggests  that  cost  risk  never  can  be  removed 
complet'.ely , 

Given  the  pre.sumed  level  of  effort  required  to  furtlier-  control  co  it 
qrov/th,  We  must  ask  if  the  problem  is  worth  the  cost  of  the  solutions. 
.Guch  Q  determination  is  beat  left  to  deci.sionmakers  concerned  wiLli  tlie 
quality  of  resource  rullocation  decision.^.  It  is  worth  pointing  out, 
however,  that  the  sum  total  estimat:ed  costs  Cor  the  DE  baseline  programs 
in  our  dat. aba.si.-’  is  more  tiian  $<150  billion  do]  larrr  (in  FY90:j),  spread 


over  several  decades.  Twenty  percent  of  that  figure  ($90  billion)  is 
significant  and  could  have  a  substantial  cumulative  effect  on  resource 
allocation  decisions,  particularly  in  times  of  increasingly  tight 
budgets . 


-  XV 1 1 


ACKV0NI-90<afBllT8 


The  authors  wish  to  acknowledge  the  assistance  of  several 
contributors,  whose  time  and  effort  made  this  research  possible.  Larry 
Axtell  of  0U3D(A)  provided  access  to  and  interpretation  of  historical 
SAR  files.  At  RAND,  Donna  Hoffman  coordinated  collection  and 
maintanance  of  our  in-house  SAR  database. 

Errors  of  omission  or  commission  are  the  sole  responsibility  of  the 
authors . 


XIX 


GLOSSARY 


CGF 

(  oat  Growth  Factor 

DE 

Development  Estimate 

EMD 

Engineering  and  Manufacturing  Development 

GAO 

General  Accounting  Office 

lOT&E 

Initial  Operational  Test  and  Evaluation 

IDA 

Institute  for  Defense  Analysis 

MILCON 

Military  Construction 

PE 

Planning  Estimate 

PdE 

Production  Estimate 

R&D 

Research  and  Development 

RDT&E 

Research,  Development,  Test  and  Evaluation 

SAR 

Selected  Acquisition  Report 

-  ]  - 

1.  INTRODOCTION 


Historically,  cost  estimation  has  posei  a  significant  challenge  to 
estimators,  planners,  and  manager  in  both  government  and  industry. 
Considerable  historical  evidence  shows  that  accurate  cost  estimation  has 
been  difficult  to  achieve  across  a  wide  range  of  projects,  including 
weapon  systems,  energy  and  chemical  processing  plants,  and  large 
construction  projects,^  The  explanation  for  this  difficulty  lies  in 
part  in  the  technical  uncertainty  inherent  in  large  scale, 
technologically  challenging  projects. 

One  result  of  this  inherent  uncertainty  is  the  persistence  of  cost 
growth  in  weapon  .system  developnient  programs.  Cost  growth  affects  the 
quality  of  decisions  concerning  U.S.  defense  policy.  Inaccurate  or 
imprecise  cost  estimates  can  distort  the  rationale  for  resource 
allocation  decisions,  comparisons  between  competing  systems,  and 
procurement  expenditures.  Unfortunately,  no  proven  method  exists  to 
identify  overly  optimistic  or  pessimistic  cost  estimates  at  the 
different  stages  Ol  a  development  program. 

Cost  growth  can  be  defined  simplistically  as  the  difference  between 
estimated  and  actual  costs.  'I'he  direction  of  error  measured  from  the 
estimate  baseline  can  be  either  to  initially  understate  costs,  in  which 
case  cost  growth  occurs,  or  to  overstate  costs,  in  which  case  a  cost 
reduction  is  realized.  The  effect  on  derision  making  is  the  same; 
however,  both  overruns  and  underruns  reduce  the  quality  of  resource 
allocation  decisions.  This  report  uses  the  term  cost  growth  to  include 
both  cost  increases  and  decreases  from  the  estimate  baseline. 

‘For  examples,  see  Edward  W.  Merrow,  et  al.,  A  Review  of  Cose 
EsLimation  in  New  Technologies ;  Implications  for  Energy  Process  Plants, 
RAND,  July  1979,  R-2418-DOE;  and  R.  W.  Hess  and  C.  W.  Myers,  Assessing 
Initial  Cost  Growth  and  Subsequent  Long-Term  Cost  Improvement  in  Coal- 
to-SNG  Processes,  Gas  Research  Institute,  August  1988,  GRI-89/0129 
(especially  Figure  1.1). 
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An  occasional  inaccurate  estimate  would  not  pose  a  significant 
problem.  A  problem  arises  only  if  cost  estimates  are  systematically 
biased.  Conventional  wisdom  is  that  cost  estimates  are  biased  downward; 
they  commonly  understate  the  actual  costs  of  a  development  program. 
Systematic  bias  can  lead  to  erratic  acquisition  decisions  (e.g.,  more 
start  and  continuation  decisions)  that  contribute  to  problems  later  in 
the  system  life  cycle,  such  as  the  "bow  wave*  phenomena  in  which  too 
many  programs  reach  high  funding  levels  at  the  same  time;  reduction  in 
operation  and  support  accounts  to  compensate  for  increases  in  the 
development  and  procurement  accounts;  and  quantity  reductions  that 
affect  force  structure  plans  and  capabilities.  Some  evidence  of  a 
downward  bias  leading  to  cost  growth  has  been  documented,,  but  little 
attempt  has  been  made  to  quantify  the  extent  of  the  bias  and  understand 
its  causes.  Improving  the  accuracy  and  precision  of  cost  estimates 
requires  both. 

As  an  estimation  goal,  we  would  like  to  see  cost  estimates  normally 
distributed  around  a  mean  of  zero,  indicating  no  systematic  bias  and 
that,  on  average,  estimates  are  reasonably  good  predictors  of  actual 
costs.  Further,  we  would  expect  the  accuracy  of  our  estimates  to 
improve  over  time  as  the  system  definition  becomes  firmer.  As 
documented  in  detail  in  later  sections  of  this  report,  actual  experience 
does  not  correspond  with  these  desired  attributes.  Figure  1.1 
illustrates  that  in  fcict  weapon  system  coc.t  estimates  hove  an  inherent 
systematic  bias  of  a  substantial  magnitude.’  Weapon  system  cost 
estimates  are  in  fact  systematically  biased,  by  about  20  percent  on 
average  in  the  early  phases  of  a  program,  and  that  bias  remains  well 
into  the  production  phase,  with  no  real  improvement  in  the  distribution 
of  errors  around  the  mean.  The  basic  goal  of  this  research  is  to 
understand  the  reasons  why  actual  experience  is  so  different  from  what 
we  might  desire  and  to  gain  insights  that  might  enable  moving  actual 
experience  toward  our  goal  of  improved  estimation  accuracy. 

^The  details  of  this  tigure--hnw  cost  growth  is  calculated,  the 
differences  between  baselines,  etc. --will  be  explained  in  more  detail  in 
later  sections  of  this  report. 
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Milestone  1  Milestone  2  Milestone  Ss 

Figure  1.1-litlmatlon  Aooureay  at  Suoaeseiva  Milestones 


The  research  presented  here  is  an  exploratory  analysis  of  cost 
growth  in  weapon  system  development  programs.  We  have  limited  this 
effort  to  information  available  in  Selected  Acquisition  Reports  (SARs), 
as  they  provide  the  most  reasonably  consistent  and  readily  available 
data  source  for  both  cost  growth  and  potential  explanatory  variables.^ 
The  objectives  of  the  research  are  * o: 

1.  Quantify  the  magnitude  of  weapon  system  program  cost  grov/th 

2.  Identify  factors  affecting  cost  growth. 

The  first  objective  is  intended  to  determine  the  extent  of  the  problem. 
The  second  objective  focuses  on  identifying  the  causes  or  drivers  of 
cost  growth.  Knowledge  of  the  underlying  reasons  for  cost  growth  would 

^An  assessment  of  the  usefulness  of  SARs  in  cost  growth  analysis 
has  been  reported  separately.  See  Maj.  Paul  Hough,  USAF ,  Pitfalls  in 
Calculating  Cost  Growth  from  Selected  Acquisition  Reports,  RAND,  N-3136 
AF,  1992. 
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facilitate  achievement  of  the  long-standing  goal  of  improving  cost 
estimating  and  controlling  costs  during  weapon  system  acquisition. 

gXUDY  OVBRVZIN 

Two  basic  research  approaches  can  be  used  to  study  acquisition 
issues,  including  cost  growth.  One  is  a  case  study  approach.  That 
approach  might  provide  considerable  detail  on  factors  that  drive  cost 
growth  in  a  few  programs,  but  the  results  would  not  be  generally 
applicable.  It  is  difficult  to  formulate  general  policy  from  a  few  case 
studies . 

Another  approach  is  che  'large-N*  study.  In  that  approach,  some 
detail  is  sacrificed  to  anable  a  much  broader  scope  study  involving 
collection  of  a  relativ'jly  few  basic  variables  on  a  large  number  of 
programs.  The  results  of  a  large-N  study  are  more  generally  applicable. 
Because  they  provide  information  on  the  relative  importance  of  factors 
at  a  more  macro-level,  policy  alternatives  can  be  formulated  more 
easily.  This  approach  is  adopted  here. 

The  results  presented  in  this  report  are  derived  from  information 
contained  in  SARs,  with  some  technical  and  programmatic  information 
supplemented  from  other  publicly  available  sources.  We  intentionally 
imposed  this  constraint  on  the  research  both  because  of  the  availability 
of  SARs  and  because  we  wanted  our  results  to  be  comparable  with  similar 
coat  growth  research.  For  reasons  that  we  wi]l  make  clear,  the  results 
of  the  many  past  cost  grow.h  studies  are  not  directly  comparable  with 
this  research  because  of  tue  differences  in  how  the  SAR  data  are 
adjusted . 

We  have  defined  cost  growth  (positive  or  negative)  as  the  current 
estimate  or  actual  costs  of  a  program  divided  by  the  baseline  estimate. 
Those  estimates  are  adjusted  for  inflation  and  changes  in  quantity,  The 
result  is  a  cost  growth  factor:  ratios  greater  than  one  indicate  cost 
overruns  (or  cost  growth) ,  and  ratios  less  than  one  indicate  a  cost 
underrun . 

The  overall  database  consists  of  the  entire  universe  of  weapon 
system  programs  that  have  reported  through  the  SAR  process  as  of  the 
December  1390  SAR.  The  actual  working  database  consists  of  197  programs 
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with  program  start  dates  ranging  from  I960  through  1990.^  Those 
programs  include  all  three  military  services  and  nine  classes  of  weapon 
systems.  The  cost  data  were  collected  in  a  time  series  format, 
supporting  both  static  or  point  estimate  analysis  <as  of  December  1990), 
as  well  as  trend  analysis.  Programmatic  characteristics  such  as 
performance  and  schedule  factors  also  were  extracted  from  the  SARs  to 
aid  in  the  exploratory  analysis. 

We  sorted  the  data  into  logical  categories  such  as  service, 
maturity,  weapon  system  type,  and  program  size.  Relationships  and 
hypotheses  were  tested  against  programmatic  data  with  a  combination  of 
simple  correlations,  graphical  representations,  and  tests  of 
significance  between  means  and  standard  deviations  of  various  groupings 
of  data.  The  results,  based  on  independent  variables  derived  almost 
exclusively  from  SAR  data,  provide  little  significant  support  for  any 
hypotheses  but  do  support  some  a  priori  notions  on  cost  growth  while 
casting  doubt  on  others. 

organisation 

Section  2  of  this  report  describes  the  research  approach  in  more 
detail,  including  a  description  of  the  SARs  and  our  database.  Section  3 
documents  the  basic  adjustments  we  made  to  the  data  and  shows  the  effect 
of  these  adjustments  on  the  results.  Section  4  begins  the  exploratory 
analysis  by  addressing  some  of  the  basics  of  cost  growth,  uuch  as 
comparisons  across  services  and  over  time.  Section  5  examinee  several 
simple  hypotheses  though^  to  explain  differences  in  cost  growth  across 
programs,  such  as  the  existence  of  prototyping  and  schedule  variance. 
Section  6  summarizes  the  res'.lts  and  suggests  future  research  that  might 
be  valuable.  The  somewhat  extensive  Appendices  include  the  current 

■‘‘The  total  number  of  SAR  programs  through  December  1990  is  214.  We 
dropped  16  programs  from  the  database  because  they  never  reported  costs 
in  constant  dollars.  These  are  all  very  early  programs,  most  of  which 
never  reported  after  March  1974.  Further,  we  have  maintained  a  combined 
line  for  the  SUBACS  program,  although  the  Navy  has  separated  the  AN/BSY- 
1  from  the  AN/BSY-2  version. 
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status  (as  of  December  1990)  of  the  programs  included  in  our  database, 
as  well  as  the  rationale  supporting  some  of  the  categorization  schemes 
used  in  this  research. 
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2.  RlflBAROM  JUi»PllOACH 


DATA  SOXmCDS 

The  DoD  Selected  Acquisition  Reports  (SARs)  are  the  basic  source  of 
information  for  this  cost  growth  analysis.  The  SAR  is  one  of  the  few 
official  management  reporting  systems  that  provides  consistent  and 
reasonably  reliable  data  on  the  status  of  DoD  accjuisition  programs.  The 
SAR  includes  a  summary  of  key  coat,  schedule,  and  technical  information 
on  major  programs  that  meet  minimum  reporting  criteria.  Cost 
information  includes  baseline  and  current  estimates  of  total  acquisition 
costs  and  is  reported  in  both  base  year  and  then  year  dollars,  allowing 
analysis  on  a  constant  dollar  basis  or  a  total  current  dollar  basis. 

The  programmatic  information  in  the  SAR  (e.g.,  schedule  and  performance 
data)  may  be  used  as  a  source  of  independent  variables  fcr  explaining 
system  cost  changes, 

Explatjations  for  the  difference  between  the  current  and  baseline 
estimates  are  given  in  the  SAR  variance  categories.  The  current  seven 
cost  variance  categories  are  defined  belowt 

1.  Economics  changes  in  price  levels  due  to  the  state  of  the  national 
economy 

2.  Quantity;  changes  in  the  number  of  units  procured 

3.  Estimatings  changes  due  to  refinement  of  estimates 

4.  Engineering;  changes  due  to  physical  alteration 

5.  Schedule;  changes  due  to  program  slip/acceleration 

6.  Support;  changes  associated  with  support  equipment 

7.  Other:  changes  due  to  unforeseeable  events. 

Allocations  to  these  categories  are  made  by  the  program  offices  using 
the  methodology  described  in  DoDD  7000. 3G  (May  1980).  The  important 
point  here  is  that  allocations  are  made  on  the  basis  of  programmatic 
effects,  not  causes,  making  the  variance  categories  unsuitable  as 
potential  explanatory  variables.  Nevertheless,  they  contain  narrative 
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and  quantitative  information  critical  to  both  our  cost  growth 
methodology  and  analysis. 

Although  formal  submisoion  of  SARs  to  Congress  began  in  1969,  they 
were  not  legally  req’aired  until  1975  (PL  94-106,  the  FY76  defense 
appropriations  bill) .  Originally  the  SAR  requirement  was  formalized  in 
DoD  Directive  7000.3,  which  has  been  revised  many  times  since  its  first 
issuance  in  February  1968.^  The  current  SAR  regulation  has  been 
published  as  Part  17  of  DoD  Tnetruction  5000.2  and  includes  descriptions 
of  format,  reporting  requirements,  and  calculations.  SARs  are  developed 
at  the  program  office  level  and  are  reviewed  by  the  Performance 
Management  Office  in  OUSD(A)  before  release. 

Figure  2.1  shown  the  number  of  new  SAR  reporting  programs  over¬ 
time.  The  height  of  the  bars  in  Figure  2.1  is  indicative  of  the  number 
of  new  program  starts  in  any  given  year,  changes  in  SAR  reporting 
thresholds,  and  the  number  of  waivers  that  either  DoD  or  Congress  allow. 
The  large  numbers  of  programs  reporting  in  the  early  1980s  reflect  the 
military  buildup  of  the  early  Reagan  Administration.  Table  2.1  shows 
the  change  in  reporting  thresholds.  Though  significantly  raising  the 
reporting  threshold,  the  1983  change  resulted  in  a  significant  increase 
in  the  number  of  programs  that  must  submit  SARs  and  reduced  DoD's 
discretion  in  choosing  which  programs  those  would  be.  However,  that 
increased  reporting  burden  was  mitigated  by  requiring  only  the  December 
GAR  to  be  comprehensive,  with  the  quarterly  submissions  mandated  only  if 
certain  variance  t  tires)ui Id.^i  were  exceeded.  Note  that  the  number  of 
programs  reporting  in  each  year  v.'ill  vary  as  a  function  of  ttie  number  of 
carryovers  from  the  previous  year,  the  number  of  new  programs,  and  the 
number  of  terminations  (cancellation  or  completion) . 

Excluding  cnn*-rTctor  and  program  office  records,  the  SAR  is  perhaps 
the  best  source  of  data  available  to  the  researcher  and  certainly  the 
most  comprehensive  database  assembled  in  one  location.  Because  of  the 
scope  of  the  data,  length  of  coverage,  and  ease  of  access;  .GAR  data  are 
the  basis  of  co.it  growth  studie.s  both  in  and  out  of  DoD.  Nevertheless, 

■'See  Hough,  1992,  for  a  description  of  these  changes. 


this  database  is  not  without  its  problems.  Among  some  of  the  well-known 
limitations  are 

1.  High  level  of  aggregation 

2.  Changing  baseline  estimates  and  program  restructuring 

3.  Changing  preparation  guidelines  and  thresholds 

4.  Inconsistent  allocation  of  cost  variances 

5.  Emphasis  on  effects,  not  causes 

6.  Incomplete  coverage  of  program  costs 

7.  Unknown  and  varied  budget  levels  for  program  risk. 

These  and  other  more  subtle  problems  are  fully  described  in  a 
companion  report.®  These  problems  can  introduce  unacceptable  error  in 

__  RANDf4H.f.l4IW 
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Doss  not  Include  speolal  eooess  programs. 
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®Hough  1992. 
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Table  a.l 

SAR  Raportlng  Threshold  Requlrenenta 

Law 

Year 

RDT&E 

Procurement 

none 

1969 

$25  million 

$100  million  (TY$) 

PL  94,-106 

1975 

$50  million 

$200  million 

PL  96-107 

1979 

$75  million 

$300  million 

PL  97-252 

1983 

$200  million 

NOTE!  Hough,  1992  (N-3136) . 

cost  growth  calculations  unless  care  is  taken  to  fully  understand  the 
SARs  for  a  specific  program  and  how  the  SAR  data  were  r/enerated.  A 
thorough  understanding  of  the  limitation  and  caveats  of  SAR  data  is 
important  in  correctly  interpreting  the  data.  SARs  are  useful  for  our 
purposes  because  they  allow  general  descriptions  of  patterns  and  macro¬ 
level  trends. 

BAfIC  NlTHODOtOOy 

A  key  question  in  cost  growth  analysis  is  how  to  measure  cost 
growth.  The  issue  ultimately  revolves  around  the  adjustments  made  to 
the  data  as  part  of  the  cost  growth  calculation.  This  section  provides 
an  overview  of  our  basic  methodology.  The  effect  of  the  various 
adjustments  is  shown  in  detail  in  a  later  section. 

A  number  of  measures  of  system  cost  growth  are  possible  given  the 
same  data.  In  general,  cost  growth  is  measured  with  respect  to  baseline 
goals  established  earlier  in  the  program.  Nominal,  or  unadjusted  cost 
growth  captures  all  program  cost  changes  from  the  baseline  v/hile 
adjusted  cost  growth  excludes  any  cost  variance  caused  .by  inflation  or 
changes  in  quantity  procured.  Nominal  cost  growth  is  an  appropriate 
measure  if  the  only  concern  is  the  impact  of  cost  growth  on  the  federal 
budget.  Adjusted  coat  growth,  however,  is  a  more  relevant  measure  when 
trying  to  determine  how  well  program  management  has  done  in  estimating 
and  controlling  costs  within  its  command.  For  example,  a  program  that 
finishes  within  budget  but  procures  only  half  the  originally  estimated 
quantity  would  demonstrate  zero  nominal  growth  but  significant  cost 
growth  when  adjusted  for  quantity.  Failure  to  adjust  for  inflation  will 
result  in  higher  cost  growth  measures  than  otherwise  would  be  the  case. 
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Moreover,  the  older  the  program  is  and  the  higher  the  inflationary 
experience,  the  greater  the  impact  on  cost  growth.  Large  quantity 
changes  ran  so  dominate  measures  of  nominal  cost  growth  that  true  cost 
performance  is  totally  masked.  We  used  che  adjusted  cost  growth  measure 
to  search  for  underlying  patterns  and  trends  in  cost  growth  over  time 
and  within  a  program. 

Determining  the  adjusted  cost  growth  for  a  given  program  is  a  two- 
step  process.  First,  the  effects  of  inflation  are  removed.  Because  the 
SAR  provides  data  in  both  base-year  and  then-year  dollars,  the  effects 
of  inflation  are  readily  apparent.  The  baseline  costs,  current  costs, 
and  cost  variances  all  are  shown  in  constant  (base-year)  and  inflated 
(then-year)  dollars.  SARs  first  included  base-year  cost  data  in  March 
1974,  and  only  16  SAR  programs  were  excluded  from  analysis  because  of 
lack  of  base-year  data.''  Adjusting  for  inflation  requires  only  that  all 
calculations  be  made  in  base-year  dollars. 

The  second  step  in  determining  adjusted  cost  is  to  remove  the 
effects  of  quantity  changes.  Adjustment  for  quantity  is  technically 
much  more  difficult  and  requires  that  the  researcher,  to  the  extent 
possible,  identify  all  cost  changes  caused  by  a  change  in  the  originally 
programmed  quantity.  After  this  amount  is  determined,  either  the 
current  estimate  can  be  adjusted  to  the  same  quantity  level  as  the 
baseline,  or  the  baseline  estimate  can  be  adjusted  to  the  current 
estimate  quantity.  While  both  methods  may  result  in  approximately  the 
same  answer,  the  latter  produces  a  floating  baseline  and  may  lead  to 
inconsi.stencies .  We  choose  to  maintain  the  integrity  of  the  baseline; 
an  established  RAND  practice  in  cost  growth  analysis  for  two  decades. 
Thus,  if  quantity  did  change,  the  current  cost  estimate  is  always 
adjusted  to  what  it  would  be  if  the  program  were  still  procuring  the 
baseline  quantity.  To  this  end,  we  use  the  following  procedure  applied 
to  each  SAR  submission  for  each  program: 


''The  cost  expenditure  profile  of  tliese  early  programs  was  not 
provided  in  SARs.  Thus,  total  program  cost  in  then-year  dollars  could 
not  be  converted  to  base-year  dollars. 
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1.  Subtract  the  previous  procurement  estimate  from  the  current 
procurement  estimate  to  determine  the  current  variance. 

2.  Identify  the  cost  variance  associated  with  quantity,  including  the 
reported  quantity  cost  variance  and  all  cost  variances  from  the 
narrative  that  are  attributed  to  quantity  but  reported  in  other 
variance  categories  such  as  schedule,  support,  engineering,  or 
estimating. 

3.  Subtract  the  total  quantity  variance  (reported  plus  narrative)  from 
the  current  procurement  variance  to  find  the  current  net  procurement 
variance.  This  number  is  the  total  cost  change  as  reported  by  the 
SAR  that  is,  not  a  result  of  quantity  change. 

4.  We  then  "normalize"  the  net  procurement  current  variance  with  the 
total  program  cost  quantity  curve  under  the  assumption  that  all 
costs,  direct  and  indirect,  are  driven  by  quantity.®  Thus  the 
methodology  accounts  for  all  quantity  induced  effects,  including 
changes  in  direct  quantity,  recurring  cost  per  unit,  cost/quantity 
curve  slopes,  and  nonrecurring  costs.  The  effect  of  the 
normalization  procedure  is  usually  minimal  but  can  be  high  when  both 
the  net  procurement  variance  and  the  quantity  change  are  large. 

5.  The  normalized  net  procurement  variance  is  added  to  t)ie  research, 
development,  test  and  evaluation  (RDT&E)  and  military  construction 
(MILCON)  variances  (not  adjusted  for  quantity)  to  determine  the  ttjtnl 
program  cost  variance  (either  positive  or  negative)  between  the? 
pi'Cviou.s  G.stlmate  and  the  current  estimate. 


Then  a  cost  growth  factor  (CGF)  is  calculated  by  taking  the  total 
program  baseline  cost,  adding  the  cumulative  total  cost  variance  to 
date,  and  dividing  by  the  total  program  baseline  cost.  This  procedure 


®The  total  program  cost  quantity  curve  was  derivf?d  from  the  annual 
funding  summary  in  the  December  1990  (or  final)  .SAR  provided  that  the 
regression  yielded  a  measure  of  fit  of  at  least  R2  >  0.70.  When  the 
least  .squars.s  line  fit  the  data  poorly,  we  used  the  average  of  "good" 
curves  from  the  same  class  of  weapon  systems.  The  theory  behind  the 
normal  i  zat  io.u  is  explained  in  detail  in  E.  Dews,  ot  al.,  Acquisition 
Policy  Ef  t'cet:  iveness ,  Appendix  A,  October  1979,  R'25 1 6 -DREl .  Hough, 
1992,  also  ctoritainr  a  good  .summary  of  the  rationale  underlying  the 
normalization  methodology. 
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was  performed  for  each  SAR  submission  for  each  program.  Total  program 
cost  growth  is  calculated  by  summing  the  adjusted  and  normalized  cost 
variance  over  all  SARs  for  the  program.  A  CGF  over  1.0  indicates  cost 
growth  while  a  CGF  less  i  f. an  1.0  demonstrates  favorable  cost 
performance.  We  also  calculated  CGFs  for  RDT&E  and  procurement  cost 
separately.  The  procurement  cost  growth  uses  the  procedure  described 
above  but  without  add.rng  development  and  MILCON  variance;  while  RDT&*^ 
cost  growth  is  simply  the  current  estimate  of  development  costs  divided 
by  the  development  cost  baseline.  By  u.sing  this  procedure  beginning 
with  the  baseline  and  ending  with  the  December  1990  SAR  (or  the  last  SAR 
for  the  program) ,  cost  growth  can  be  calculated  at  annual  intervals  fox 
the  program  as  well  as  the  most  recent  cost  growth  (as  of  December  1990) 
for  the  program. 

DATABXSB  OVKRVlBtf 

The  database  includes  197  programs  as  of  the  December  1990  SAR. 
These  programs  are  distributed  across  the  three  military  services  and 
across  weapon  system  types  as  shown  in  Table  2.2.  About  25  percent  of 
the  total  IS  accounted  for  by  each  of  electronics  and  missiles  and  an 
additional  25  percent  by  ships  and  aircraft  combined.  Appendix  P 
provides  the  rationale  for  tho  system  type  categorization  of  each 
program,  '^able  2.3  lists  all  programs  by  category. 


Table  2.2 

Distribution  by  Weapon  System  Type 


System  Type 

Ail  Force 

Army 

Mavy 

OSD 

TOTAL 

Aircraft 

14 

0 

9 

0 

23 

Missile 

19 

20 

17 

0 

56 

1.0 1  icopter 

1 

5 

2 

0 

6 

Electronic 

.30 

13 

19 

0 

52 

Muni t ion 

1 

7 

4 

0 

12 

Vehicle 

0 

8 

1 

0 

9 

Ship 

0 

0 

21 

0 

24 

.Space 

6 

0 

0 

7 

Ot,  her 

2 

1 

'n 

1 

6 

TOTAL 

63 

54 

79 

1 

197 
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A  program  can  have  three  SAR  baselines  over  its  life  cycle.  The 
Planning  Estimate  (PE)  is  the  earliest  and  occurs  around  Milestone  1. 

The  PE  has  not  always  been  included  in  SARs;  it  was  only  recently  that  a 
PE  baseline  submittal  was  required.  Currently,  major  programs  must 
submit  a  PE  baseline  EAR  that  corresponds  with  the  RDT&E  program; 
although  procurement  estimates  are  often  included,  they  are  not 
required.  The  DE,  associated  with  Milestone  2  (BMD  start),  has  been  the 
most  common  baseline  and  does  include  total  program  acq^iisition  costs 
(RDT&E,  procurement,  and  military  construction) ,  The  production 
estimate  (PdE)  is  made  about  the  time  of  Milestone  3a  or  the  beginning 
of  production  and  also  includes  total  program  costs.  Often,  however, 
one  of  the  earlier  baseline  estimates  (PE  or  DE)  is  maintained 
throughout  the  program,  and  the  PdE  never  is  shown  formally  in  the  SAR. 
The  majority  of  programs,  particularly  older  programs  (i960s  and  1970e' . 
have  only  development  estimates.  For  some  programs,  PE  and  PdE 
baselines  were  estimated  using  Milestone  1  and  Milestone  3a  dates  to 
indicate  the  initial  (PE)  baseline  or  the  current  estimate  at  the  time 
the  program  was  transitioning  to  production  (PdE) .  Thus,  each  program 
could  have  three  different  baselines.  Our  database  includes  only  five 
programs  where  this  is  the  ca.  e,  but  we  have  many  programs  with  at  least 
two  baselines.  Since  cost  growth  must  always  be  referenced  to  a 
baseline,  we  end  up  with  27B  distinct  cost  growth  factors,  distributed 
across  the  three  baselines  as  in  Table  2.4.  Because  combining  baselines 
blurs  fundamental  distinctions  relating  to  program  maturity  and 
information  availability,  the  analyses  were  conducted  separately  for 
each  of  the  three  baselines. 


Table  2.4 

Distribution  by  Basollna  Type 


Number 

Percent  of  Total 

Planning  estimate 

38 

13.7 

DeveJopment  estimate 

150 

54.0 

Production  estimate 

90 

32.3 

TOTAL 

278 

100.0 
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The  basic  variables  included  in  our  analysis  and  a  brief 
description  of  each  are  included  in  Table  2.5.  The  four  basic  types  of 
variables  are  categorical  descriptors,  schedule-related,  cost-re] ated, 
and  performance-related.  For  the  most  part,  each  of  the  variables  in 
Table  2.5  is  either  a  variable  that  enables  the  database  to  be  sorted  in 
particular  ways  or  a  potential  explanatory  variable.  These  variables 
either  were  extracted  directly  from  the  SAR  or  else  derived  from 
information  available  in  the  SAR. 

The  categorical  variables  we  examined  are  based  on  the  notion  that 
differences  ir.  cost  growth  may  exist  between  specif ied  groupn,  such  an 
prototype  versus  nonprototype  programs,  across  services  or  weapon  types, 
or  between  modification  and  new  programs.  These  variables  allowed  us  to 
construct  subsets  of  the  database  for  comparative  analysis. 

The  schedule-related  variables  are  important  in  that  time-related 
variables  or  the  timing  of  the  program  may  influence  cost  outcomes. 

These  variables  were  all  calculated  based  on  the  calendar  dates  listed 
in  the  SAR  for  specific  milestones:  Milestones  1,  2,  3a,  first 
operational  delivery,  and  the  start  and  completion  of  Initial 
Operational  Test  &  Evaluation  (IOT«kE).  When  possible,  both  the  planned 
and  actual  date  were  obtained  for  each  event.  Thus  the  planned  and 
actual  lengths  of  various  intervals  (calculated  in  months)  and 
percentage  changes  (e.g.,  schedule  slip)  could  be  derived.  These 
measures  were  used  a-s  pocsible  factors  explaining  or  affecting  cost 
growth . 

The  cost  variables  include  the  data  needed  for  the  cost  grov/th 
caicuLdtion  as  well  as  ior  calculating  weighted  averages.  Using 
constant  prciram  baseyear  dollar.9  for  RDTSE,  procurement  and  military 
coinst ruct ion  costs,  the  cost  growth  for  each  baseline  was  calculated  as 
described  earlier.  The  total  program  acquisition  cost  at  the  time  of 
the  base-line  estim.ite  wa.s  used  as  the  basis  for  calcvilat  i  ti','  weighted 
averages.  We  also  split  out  the  cost  growth  associated  with  the  HDT&E 
and  procurement  program  to  sea  if  the:  were  any  diftarences  in  the 
t a c t  o r  n  a  1. 1 e c t  i n g  them. 
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Table  a. 5 

■lananta  of  the  Database 

Variable 

Descriotlon 

Categorical  Descriptors 

Program  name 

Common  name  and  system  designation 

Service 

Military  service  with  management 

responsibility 

Weapon  type 

Weapon  system  classification 

Contractor 

Prime  contractor  (s) 

Prototype  indicator 

Designates  prototype /nonprototype 

Confidence 

Assessmeut  of  confidence  in  prototype 

designation 

Precedent 

Prior  experience  with  eystem/technology 

Modification  indicator 

Designates  modif icaticn/new  start 

Unit  quantity  change 

Direction  and  magnitude  of  quantity 

change  from  each  baseline  type 

Schedule  Related 

Program  initiation 

Year  of  Milestone  1  (or  equivalent) 

Development  start 

Year  of  Milestone  2  (or  equivalent) 

Years  past  program  initiation 

Maturity  metric  based  on  Milestone  1 

Years  past  development  start 

Maturity  metric  based  on  Milestone  2 

Phase  1  plan 

Planned  time  (months),  Milestone  1  to 

Milestone  2 

Pnase  1  actual 

Actual  time  (months) ,  Milestone  1  to 

Milestone  2 

Phase  2  plan 

Planned  time  (months),.  Milestone  2  to 

first  delivery 

Phase  2  actual 

Actual  time  (months) ,  Milestone  2  to 

first  delivery 

Total  planned  length 

Planned  time  (months),  Milestone  1  to 

first  delivery 

Actual  program  duration 

Actual  time  (months).  Milestone  1  to 

first  delivery 

Concurrency  (1) 

CDO  metric  (August  1988) 

Concurrency  (2) 

Difference  between  Milestone  3a  and  lOT&E 

completion 

IOT&R  alip 

Difference  between  planned  and  actual 

lOT&E  completion 

he  veil  ot  effort 

Hutio  Phase  1  length  to  Phase  2 

Cost  Related 

Coat  growth  factor 

Total  program,  one  for  each  baseline 

Program  size 

Total  program  cost  in  FY89$ 

Cost  distribution 

R.atio  RDTSiE  to  procurement  costs  fcjr  both 

ba.se line  atid  current  '.'stimates 

RDT&E  cost  growth 

Cost  change  for  RDT(<E  only 

Procurement  coat  growth 

Cost  change  for  procurement.,  normalized 

Perfi  <rnuince  Related 

c’otiipouite  performance  ratio 

Average  ratio  of  all  performance  metrics 

Compo;.'i ite  operational  ratio 

Average  ratio  of  operational  metrics 

Compoaite  technical  ratio 

Average  ratio  of  technical  metrics 

Performance  short lali  ratio 

Ratio  of  number  indicators  not  met  to 

total 
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The  performance  related  variables  are  based  on  the  performance 
section  in  the  SAR,  which  lists  the  estimated  and  demonstrated 
performance  across  a  number  of  indicators  relevant  to  each  program.  We 
calculated  performance  ratioc  in  a  manner  similar  to  the  cost  growth 
calculation  with  similar  interpretations:  ratios  less  than  one  indicate 
that  the  system  did  not  achieve  the  performance  goal;  while  ratios 
greater  than  one  indicate  performance  above  the  goal.  The  ratios  are 
used  as  a  proxy  for  technical  difficulty,  a  commonly  cited  factor 
affecting  cost  growth. 
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3.  Tin  irrscTg  op  data  adjdstnbnt 


The  particular  adjustments  made  tn  SAR  cost  data  can  affect  the 
results  of  a  cost  growth  analysis.  The  adjustments  made  to  the  data 
should  reflect  the  goals  of  the  study.  For  instance,  if  the  objective 
of  the  study  is  to  show  current  budgetary  impact,  then  no  adjustment 
should  be  made;  data  that  reflect  the  effect  of  all  inflationary  and 
scope  changes  are  required.  On  the  other  hand,  if  the  research  goal  is 
to  identify  the  factors  affecting  cost  growth  and  suggest  strategies  for 
mitigating  the  effect  of  those  factors,  then  the  data  should  be  adjusted 
to  reflect  only  those  things  that  are  rensonably  within  the  cost 
estimator's  ability  to  estimate  and  the  manager's  ability  to  control. 

The  estimator's  role  in  causing  and  mitigating  cost  growth  is  an 
important  issue.  It  is  unreasonable  to  expect  precise  accuracy  in  a 
cost  estimate  for  an  advanced  system,  especially  very  early  in  a  program 
when  the  system  definition  is  still  evolving.  The  discussion  of  Figure 
1.1  (see  p.  2)  suggested  that  the  desired  estimation  goal  would  reflect 
an  unbiased  estimate  with  an  expected  variance  of  zero  and  a  narrowing 
band  of  error  over  time.  However,  there  are  questions  as  to  the 
responsibilities  of  an  estimator.  For  instance,  since  both  schedule  and 
technical  goals  can  affect  cost  outcomes,  should  the  estimator  be 
responsible  for  questioning  unrealistic  goals,  based  on  historical  data? 
Alternatively,  the  estimator's  role  can  be  defined  as  simply  calculating 
costs  based  on  a  given  methodology  and  various  schedule  and  technical 
inputs.  Although  generally  the  broader  view  of  the  role  of  the 
estimator  is  adopted,  tiAR  data  allow  adjustment  only  for  inflation  and 
quantity  change  that  occur  after  the  estimate  has  been  made,  items  that 
cannot  reasonably  be  attributed  to  cost  estimation  error. 

Unfortunately,  some  otner  items  are  beyond  the  estimator's  control  and 
we  cannot  normalize  them;  these  include  changes  to  schedule,  production 
rate,  scope,  configuration,  and  degraded  performance.^ 

^Performance  degradation  is  important  as  it  can  be  considered  a 
nonmonetary  cost.  Thus  an  important  caveat  is  that  we  cannot  normalize 
for  relative  performance  achieved.  Also  we  cannot  account  foi  costs 
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Adjustments  also  need  to  be  made  to  ensure  the  compatibility  o£ 
data  across  programs.  While  the  directives  governing  SAR  preparation 
are  intended  to  be  applied  consistently  across  programs  and  between  the 
services,  differences  do  arise  in  practice.  Such  differences  can  affect 
the  results  of  analyses  using  SAR  data.  To  achieve  the  goals  of  the 
current  research,  the  data  were  adjusted  significantly,  both  in  terms  of 
interpreting  the  data  in  the  SAR  and  adjusting  that  data  as  part  of  the 
cost  growth  calculation.  This  section  discusses  these  adjustments, 

XNTBRPRBTZVI  ADOVSTMBKTS 

A  companion  report  documents  several  problems  involved  in  using  SAR 
data  for  cost  growth  analysis. Inattention  to  those  problems  results 
in  some  distortion  in  the  cost  growth  figures  derived  from  the  SARs. 

This  research  follows  the  measures  discussed  in  that  report  to  mitigate, 
to  the  extent  possible,  any  distortion  resulting  from  the  quality  and 
our  use  of  the  data. 

Our  basic  rule  was  to  maintain  the  integrity  of  the  baseline.  When 
collecting  data  from  the  SARs  in  a  time  series  format,  a  common 
occurrence  is  that  the  baseline  changes  for  a  particular  program. 
Sometimes  the  change  is  to  a  new  baseline  type  (e.g,,  PE  to  DE) ;  in  this 
case  we  simply  calculate  cost  growth  using  both  baselines  and  treat  them 
separately.  Sometimes,  however,  a  given  baseline  type  changes,  for 
example,  revising  the  DE  baseline  several  years  after  the  initial  DE. 
Reasons  for  that  type  of  baseline  revision  vary  considerably,  from 
correcting  previous  inflati'>n  estimates  to  adding  the  costs  of  a  scope 
change.  We  treat  such  char<ies  as  cost  variance  and  do  not  adjust  to  the 
ba.geline. 

Another  type  of  interpretive  adjustment  that  should  be  made 
concerns  the  splitting  or  joining  of  programs.  The  most  common  forms 
are  sequential  modei.j  (e.g.,  F-15A/B,  C/D,  and  E  versions).  While  major 
changes  to  an  existing  system  should  be  considered  as  separate  programs 
for  the  purposes  of  cost  growth  calculations,  usually  the  .nARs  do  not 

associated  with  fixing  performance  problems,  sine,'  they  are  often  in  the 
operations  and  maintenance  accounts. 

■OHough,  Pitfalls,  1992. 
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provide  the  information  necessary  to  break  out  the  costs  associated  with 
different  models.  In  the  other  direction,  a  problem  program  is 
sometimes  split  into  its  component  parts,  allowing  each  to  be 
rebaeelined.  The  result  is  a  decrease  in  cost  growth.  One  example  was 
the  Navy  3UBACS  program,  which  was  split  into  the  AN/BSY-1  and  -2 
programs.  The  SARs  reported  them  as  separate  programs  for  several  years 
but  then  combined  the  AN/BSY-2  into  the  SSN-21  SAR.  However,  since  the 
scope  did  not  change,  we  treated  them  as  a  single  program  corresponding 
to  the  baseline  in  the  original  SAR. 

NORMALIZATION 

The  quantitative  adjustments  to  the  data  can  affect  the  measured 
cost  growth  considerably.  Since  our  ultimate  research  goal  was  to 
identify  the  factors  affecting  cost  growth,  we  wanted  to  remove  the 
effects  of  factors  beyond  the  control  of  cost  estimators  at  the  Lime 
they  develop  the  baseline  estimate.  These  include  the  effects  of 
inflation  and  quantity  changes.  In  performing  the  cost  growth  analyses, 
a  specific  baseline  type  needs  to  be  chouen  that  will  remain  consistent 
throughout.  We  further  sorted  the  database  by  program  size  and  program 
maturity.  The  result  is  a  better  reflection  of  potentially  controllable 
cost  growth. 

We  accounted  for  inflation  by  performing  all  calculations  in 
constant  base-year  dollars.  Changes  in  quantity  are  accounted  for  by 
usiiiq  .lAR  data  via  the  specific  niethodoloqy  discussed  In  t.he  previous 
sect  ion.  The  bn.sic  rule  was  to  adjust  tiie  cost  variance  to  the  batu.iLine 
quantity  each  time  the  quantity  changed.  The  effects  of  data 
adjustments  are  summarized  in  Table  3.1  for  DE  b.tseline  proqramf  as  of 
the  December  1988  SAR.  Each  successive  adjustment  changes  the  resulting 
average  cost  growth.  Inflation  and  quantity  are  shown  to  have  the 
largest  effect  on  cost  growth:  the  avei.igo  no.st  growth  tor  125  programs 
after  nonnalizatior  is  42,  percentage  points  lower  than  the  iinadjinsted 
result.  This  result  accounts  for  much  ol  the  difference  between  our 
resuLtn  and  t.hose  published  by  the  Geru'ral  Account  ing  Office  (CiAO)  .** 

"See,  for  example,  Weapons  Cost;  AnctlyisiB  of  Major  Weapon  System 
Cost  and  Quantify  Changes,  GAO/N.SlAn-8'')--32F55,  November  1  988. 
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Tabl«  3.1 

l£<«at  o£  Data  Adjuataaat 


cost  Growth 
Factor 

Number  of 
Observations 

Unadjusted 

1.71 

125 

Adjusted  fori 

Inflation 

1.35 

125 

Quantity 

1.29 

125 

Further  sorts  by: 

Maturity 

1.30 

107 

Program  size 

1.20 

107 

NOT£:  Adjustments  are  cumulative  and  inclusive. 


Data  from  SAHs  as  of  December  1968. 

Another  important  adjustment  ia  for  program  sise,  This  adjustment 
is  substantive t  though  it  is  not  directly  related  to  cost  estimation. 

As  Figure  3.1  illustrates,  a  strong  relationship  exists  between  program 
size  and  cost  growth.  Smaller  programs  tend  to  incur  higher  cost 
growth.  Part  of  the  explanation  for  this  relationship  is  found  in  the 
cost  growth  calculation  itself .•  a  small  dollar  change  in  a  small 
program  niay  be  proportionately  greater  than  a  larger  variance  in  a 
larger  program.  Additionally,  smaller  programs  might  not  receive  the 
same  level  of  management  attention  as  larger  dollar  value  programs. 
Alternatively,  smaller  programs  may  have  proportionately  more  of  their 
costs  in  research  and  development  (R&D)  accounts,  which  as  we 
demonstrate  later,  incurs  generally  higher  cost  growth.  Table  3.2  shows 
the  effect  of  program  size  and  baseline  type  on  average  cost  growth  for 
all  programs  in  the  database.  A  simple  average  cost  growth  factor  is 
seven  percentage  points  higher  than  a  weighted  average  for  all  programs 
in  the  database.  The  weight  used  here  is  the  total  estimated  baseline 
acquisition  cost  (in  FY90  dollars) .  While  still  somewhat  crude, 
weighted  averages  better  reflect  the  actual  budgetary  impact  of  cost 
growtii  by  accounting  fur  program  size:  small  percentage  changes  in 
large  programs  may  be  more  important  than  large  changes  in  smaller 
programs.  Because  of  this  effect,  all  averages  will  be  presented  os 
weighted  rather  than  simple  averages. 
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Baseline  total  program  cost  (millions  FY90$) 


Fleur*  3.1~Coit  Growth  v*r*u*  Proeram  si** 

Tatol*  3. a 

Bff«ct  ot  Proeram  81s*  on  cost  Growth  hvoraga* 

_ _ _ _ _ simple  Average  . . We ighted  Average  _ 


Total  databfl 

ise  (n=278 

) 

1. 

20 

1 

.13 

Planning  eat 

:imate  (n= 

38) 

1. 

19 

i 

.  14 

Development 

est imate 

{n=lB0) 

1  . 

30 

1 

.20 

Production  e 

■stimate  ( 

nz90) 

1. . 

04 

1 

■  02 

NOTE:  Data 

adjusted 

for  inflation 

and  quantity. 

Previously  we  mentioned  the  importance  of  referencing  cost  growth 
to  a  consintont  baseline.  Table  3.2  shows  that  the  difference  across 
baseline  types  can  be  substantial.  The  implication  i.s  that  all  analyses 
must  be  performed  for  each  baseline;  mi.'ciny  braseline  types  will  distort 
^he  results.  Kurt.her,  results  ot  analysis  using  a  mixed  baseline  data 
set  are  difficult  to  interpret  because  of  the  differences  in  timii'q  and 
quality  of  estimating  inherent  in  each  baseline  type.  We  have  chosen  t.o 
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present  the  analysis  using  the  DE  baseline,  because  it  is  more  highly 
represented  in  our  database  and  is  more  common  in  other  studies. 

The  age  of  a  program  correlates  significantly  with  cost  growth 
outcomes.  That  relationship  is  shown  in  Figure  3.2;  older  programs  tend 
to  have  higher  cost  growth,  a  strong  correlation  that  tends  to  dominate 
most  other  cost  growth  drivers.  This  relationship  can  be  explained  in 
part  by  the  accumulation  of  problems  and  changes  in  a  program  over  time. 
Also  product  improvements  to  enhance  system  performance  may  cause  more 
costs  to  be  incurred  and  the  coat  growth  factor  to  increase  over  time. 

To  date  we  have  not  been  able  to  account  for  this  effect  in  our 
analysis.  On  average,  a  2.2  percent  per  year  increase  occurs  above 
inflation  as  a  program  ages,  although  the  variance  is  high.  While  the 
figure  measures  maturity  as  years  past  EMD  start,  the  same  basic  pattern 
holds  if  we  measure  yearo  past  program  initiation  (Milestone  1) .  The 
implication  for  cost  growth  analysis  is  that  a  distorted  result  occurs 
if  program  age  is  not  accounted  for.  We  have  chosen  a  simplistic  way  to 
account  for  maturity:  we  define  maturity  as  three  or  more  years  past 
EMD  start.  The  effect  of  this  somewhat  arbitrary  definition  is  shown  in 
Table  3.3.  Younger  programs  have  significantly  lov/et  cost  giuwu.i 
factors,  on  average,  because  fewer  events  affecting  cost  growth  have 
occurred. 

We  have  demonstrated  that  normalization  has  a  significant  effect  on 
the  resulting  cost  growth.  In  the  analyses  that  follow,  all  the  data 
have  been  treated  accordingly,  unless  otherwise  stated.  Specifically, 

1.  All  cost  calculations  use  constant  baseyear  dollars 

2.  Cost  variance  has  been  normalized  to  the  baseline  quantity 

3 .  Only  programs  three  or  more  years  past  EMD  start  are  included 

4.  Only  the  UE  bQ.seline  is  used'' 

5.  Weighted  averages  are  used  when  appropriate. 

'•■We  have  performed  analyses  similar  'to  those  presented  in  the 
remainder  of  this  report  for  all  three  baselines.  While  the  magnitude 
of  a  specific  relationship  may  differ,  the  overall  patterns  are  fairly 
consistent  across  baselines. 

"similar  analyses  were  performed  for  the  PE  and  PdE  baselines,  but 
the  results  are  not  presented  here. 


0  2  4  6  8  10  12  14  16  18  20 

Years  past  engineering  and  manufacturing  development  start 

figure  3i2-a££eat  of  Maturity  on  Coat  Growth 


Table  3.3 

Bffaot  of  Maturity  on  Cost  Growth 


Years  Past  EMD 
Start 

Cost  CSrowth 
Factor 

Number  of 
Observations 

Total  DE 

1 .20 

150 

Less  than  two 

1.14 

22 

Three  or  more 

1.20 

120 

NOTE:  DE  baseline,  weighted  average.  The  start  of 
development  could  not  be  determined  for  eight  programe 
witn  a  DE  baseline:  Safeguard,  DSP,  A-7E,  LHA,  E-4, 
CELV,  VAST,  and  SDS/GPALS. 
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4.  THB  BASICS  OF  COD  COST  GROWTH 


This  section  addresses  some  of  the  more  common  questions  associated 
with  weapon  system  cost  growth  by  presenting  some  of  its  basic 
characteristics.  These  include  overall  magnitude,  differences  between 
services  and  weapon  types,  and  some  basic  time  trends.  The  information 
provided  here  forms  a  basis  for  the  more  exploratory  causal  analyses  of 
Section  5. 

BASIC  DirFBRXNCBSi  SBRVICB8,  WEAPON  TYPE,  PROGRAM  PHASE 

The  first  question  usually  asked  iss  What  is  the  overall  magnitude 
of  DoD  cost  growth?  We  have  already  shown  the  basic  fallacy  of  this 
question!  overall  average  DoD  cost  growth  has  many  interpretations. 

Cost  growth  must  be  referenced  to  a  specific  baseline  type.  Table  4.1 
shows  that  for  the  DE  baseline,  the  weighted  average  total  program  cost 
growth  for  programs  throe  or  more  years  past  EMD  start  is  20  percent.^'* 
This  result  is  somewhat  lower  than  that  found  in  other  studies  because 
of  the  composition  of  the  database  and  differences  in  the  adjustments 
made  to  the  data. 

Table  4.1  also  addresses  another  commonly  asked  question,  what  are 
the  differences  between  the  military  services.  We  might  expect 

Table  4.1 


Differences  Between 

Services 

Average 

Average  Age 

Co.st  Growth  Number  cf 

Program  Cost 

(yeart3  past 

.Service 

Factor  Observations 

(billions  FY90$) 

EMD) 

Total  DE 

1.20 

120 

5.5 

9.4 

Air  Force 

1  .20 

41 

6.7 

8.7 

Army 

1  .  3  h 

28 

2.7 

10.3 

Navy 

1.16 

51 

6.1 

9 . 5 

NOTE: 

HE  ba:3eline, 

weighted  average,  i 

mature  programs. 

'''The  weighted  average  cost  growth  for  other  taaselinen  (mature 
programs  only)  is  14  percent  for  the  PE  {n-24)  and  3  percent  for  PdE 
(n  =  81)  . 
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differences  in  cose  growth  outcomes  because  of  differences  in  management 
styles  between  the  services.  The  Air  Force  appears  to  be  about  average, 
the  Navy  is  somewhat  lower  than  the  average,  and  the  Army  appears  quite 
a  bit  higher  than  the  average.  As  shown  in  Table  4.1,  some  part  of  the 
reason  for  this  difference  is  tliat  Army  progriums  tend  to  be  smaller  and 
older  than  those  of  either  of  the  other  two  services.  Smaller  programs 
tend  to  incur  higher  cost  growth,  and  Army  programs  are  approximately 
half  the  size  of  Air  Force  or  Navy  systems.  Additionally,  the  group  of 
Army  programs  used  here  is  about  1.5  years  more  mature  than  the  programs 
of  the  other  services,  on  average,  and  older  programs  tend  to  show  more 
cost  growth.  Nevertheless,  these  factors  can  account  for  only  a  small 
part  of  the  difference  between  tlic  Army  and  the  other  services. 

Differences  across  weapon  system  types  might  also  drive  differences 
between  the  services.  Table  4  2  provides  the  v/eighted  average  cost 
growth  for  nine  weapon  system  categories.  The  hypothesis  is  that 
differences  in  technical  difficulty  inherent  in  different  system  types 
would  be  reflected  in  cost  growth  outcomes.  Aircraft,  electronics,  and 
munitions  are  all  about  equal  to  each  other  and  are  slightly  higher  than 
the  total  DE  baseline  average.  Helicopters  and  vehicles  appear  to  be 
considerably  higher  than  the  average.  These  system  types,  dominated  by 
the  Army,  are  on  average  both  smaller  and  more  mature  than  other  system 
types.  Snips  appear  to  incur  significantly  less  cost  growth  on  average 
than  other  system  types,  perhaps  because  of  technical  differences  that 
make  ships  less  uncertain  to  estimate,  a  relatively  sophisticated  Navy 
cost  analysis  capability,  or  the  absence  of  most  ship  combat  systems 
from  ship  system  SAks.  While  some  of  these  differences  might  appear  to 
be  large,  the  very  small  sample  size  for  some  of  these  groupings  should 
be  ..onsidered.  It  is  not  possible  to  generali7,e  from  many  of  these 
groupings . 

Another  commonly  asked  question  concerns  differences  between 
program  phases:  development  versus  production.  We  might  expect  that 
RDT&E  costs  would  reflect  higher  cost  growth  because  most  of  the 
technical  difficulties  are  worked  out  in  the  development  phase.  Table 
4.3  provides  some  support  for  this  notion.  The  RDT&E  portion  of  a 
program  incu  "3  higher  cost  growth,  on  average. 
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Tabl*  4.2 

Cent  Growth  by  Systm  Typ* 


Weapon 

Type 

Cost 

Growth 

Factor 

Number  of 
Observations 

Average  Program 
Cost  (billions 
FY90$) 

Average  Age 
(years  oast  EMD) 

Aircraft 

1.28 

14 

13.8 

10.5 

Helicopter 

1.13 

5 

8.1 

13.0 

Mi ssile 

1.17 

44 

5.1 

9.5 

Electronic 

1.24 

27 

2.2 

8.5 

Munition 

1.22 

7 

1.7 

7.7 

Vehicle 

1.71 

3 

3.0 

12.0 

Space 

1.16 

3 

2.0 

12.0 

Ship 

1.10 

14 

7.5 

9,1 

Other 

0.99 

3 

3.0 

5.7 

NOTE:  DE  baseline,  weighted  average,  mature  programs. 


Tabl*  4.3 

Dlffcrancoa  Batwaon  Progran  Phaaa 


Cost 

Average  Program 

Average  Age 

Growth 

Number  of 

Cost  (billions 

(years  past 

Appropriation 

Factor 

Observations 

FY90$) 

EMD) 

RDT&E 

1.25 

115 

1.3 

9.4 

Procurement 

1.18 

115 

4.5 

9.5 

NOTE:  DE  baseline,  weighted  average,  mature  programs. 


TINS  TRBMDB 

One  of  tht  most  commonly  asked  questions  concerning  cost  growth  is: 
Have  things  improved  over  time?  Weapon  system  cost  growth  has  been 
recognized  as  a  problem  for  many  years,  and  several  attempts  have  been 
made  to  improve  cost  performance.  Figure  4.1  includes  some  of  the  more 
important  regulatory  and  administrative  initiatives  implemented  over  the 
last  20  years  that  were  intended  to  improve  cost  performance  in  weapon 
system  development.  For  example,  one  of  the  1901  Carlucci  initiatives 
specifically  addressed  Che  issue,  and  several  other  initiatives 
addressed  related  issues  (e.g.,  risks).  The  expectation  was  that  cost 
growth  would  iruprove  over  time  through  the  implementation  of  these  and 
other  pact  initiatives. 
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Blue  Ribbon  Defense  Panel 
(Fitzhugh  Commission) 

DoDD  5000.4  (CAIQ) _ 

DoDD  5000.3  (T&E) 


OMB  Circular  A*1 00 


Defense  Resource  Mgnt  Study 


Nunn-McCurdy  (thresholds) - 

CICA - 

Packard  Commission 
Qoldwater-Nichols  (reorganization) 


1969 

1970 

1971 

1972 

1973 

1974 

1975 

1976 

1977 

1978 

1979 

1980 

1981 

1982 

1983 

1984 

1986 

1986 

1987 

1988 

1989 

1990 

1991 

Packard  Initiatives  published 


DoDD  5000.1  (Major  System  Acquisitions) 
Commission  on  Qovt  Procurement 


DoDI  5000.2  (Major  System  Acquisitions) 
DoDD  5000.28  (DTC) 


■  Acquisition  Cycle  Task  Force 

'  CarluccI  Initiatives  (AlP) 

Grace  Commission 

DoDD  5000.43  (streamlining) 

DoDD  5134.1  (USD(A)) 

DoDD  5000.40  (DAB) 

Defense  Management  Review 

Revised  DoDI  6000.2  (Major  System  Acquisitions) 


rlgure  4.1-Seleeted  Aoquialtion  Initlativea 


As  alre^ady  mentioned,  for  every  year  past  EMD  start  (see  Figure 
3.2)  cost  growth  (above  inflation)  increases  an  average  of  2.2  percent 
per  year.  This  figure  is  somewhat  lower  than  the  5.6  percent  per  year 
cited  in  a  previous  report'’  and  ai.so  lower  than  tfie  3  percent  per  year 
result  obtained  using  data  current  through  December  1988,  but  it  remains 
a  substantial  trend.  The  differences  in  magnitude  in  iarge  part  are 
explained  by  differences  in  the  program  sample, 

Figure  4.2  presents  another  way  to  loo)<  at  cost  growth  trends.  It 
plots  the  weighted  average  cos*-  growth  for  programs  in  five  year 
intervals  based  on  the  year  of  EMD  start.  Since  the  196C -64  interval 
has  few  programs,  generalization  it?  not  possible.  The  trend  from  1965 


'‘’Dew.s,  et  al  .  ,  Acquiaition  Policy  Ef Eoct ivetwna ,  October  1979. 
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to  the  present  appears  to  show  a  decrease  in  average  cost  growth, 
indicating  the  improvement  we  would  expect  as  a  result  of  the  various 
cost  and  acquisition  initiatives.  Unfortunately,  the  differences  in 
average  age  largely  acco\mt  for  the  apparent  improvement.  Given  that 
programs  tend  to  incur  more  cost  growth  as  they  mature  because  of  an 
accumulation  of  problems  and  program  changes,  we  fully  expect  the  cost 
growth  averages  for  the  1980-84  and  1985-89  intervals  to  increase. 

Taking  that  into  account,  it  appears  that,  on  average,  weighted  average 
total  program  cost  growth  has  been  fairly  constant  over  time,  averaging 
around  20  percent. 

The  implications  of  Figure  4.2  are  somewhat  disappointing, 
especially  to  the  DoD  analysts  and  managers  who  have  tried  to  control 
cost  growth.  These  officials  often  adopt  an  alternative  way  to  evaluate 
cost  growth  improvement  over  time--examining  year-to-year  changes  in 
aggregate  coat  for  a  set  of  programs.  Figure  4.3  presents  the  results 
of  such  an  exercise.  Cost  growth  is  here  defined  as  the  annual  change 
from  December  to  December  for  all  programs  reporting  in  those  years,  a 
very  different  measure  than  the  one  adopted  here.  Thus,  the  number  and 
mix  of  programs  change  each  year,  and  cost  growth  is  measured  as  the 
percent  difference  in  variance  as  a  percentage  of  total  costs  for  each 
year,  calculated  in  the  aggregate.  Negative  changes  indicate 
improvement.  Figure  4.3,  representative  of  the  basic  pattern  that 
emerges  from  this  calculation,  sometimes  is  referred  to  as  a  "hump 
chart.  Measured  in  this  way,  cost  growth  peaked  in  1980,  followed  by 
sevei  il  years  of  steady  decrease.  While  the  pattern  indicates 
improvement,  the  limitations  of  this  view  should  be  understood.  First, 
Figure  4.3  doeo  not  provide  information  about  the  resource  allocation 
implications  of  cost  growth;  it  only  indicates  that  1989*3  total  growth 
across  all  programs  is  less  than  1988*3.  Second,  the  data  are  subject 
to  the  same  interpretation  issues  as  in  Figure  4.2.  The  number  of 

i'*For  example,  see  AIR  FORCE  Magazine,  April  1989,  p.  23. 
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observations  changes  in  each  year,  and  the  effects  of  maturity  may 
dominate  the  result,  as  indicated  oy  the  very  high  proportion  of  PE  and 
DE  baselines.  This  pattern  corresponds  closely  with  the  introduction  of 
new  programs  (see  Figure  2.1),  and  new  programs  tend  to  have  lower  cost 
growth.  Lastly,  the  data  include  mixes  of  all  three  baseline  types, 
which  tends  to  distort  actual  aggregate  cost  per form, ance .  For  these 
reasons.  Figure  4.3  does  not  provide  firm  eviuence  of  improvement  over 
time . 


Engineering  and  manufacturing  development  start  interval 

Figure  4.2-CoBt  Growth  Sxperienoe  over  Time 


Jl 


10 


Y«ar 

Flgur*  4  4  3-Annu*l  Chang*  In  Coat  Orewth 


The  tendency  for  programs  to  incur  more  cost  growth  as  they  mature 
is  clearly  demonstrated  by  examining  the  cost  growth  profiles  of 
individual  programs.  Figure  4.4  shows  the  four  basic  ,  ‘ofiles  that 
emerged  after  comparing  83  different  programs. The  turn-down  profile 
accounts  for  about  35  percent  of  the  programs  examined,  with  the  turn¬ 
down  point  usually  occurring  several  years  after  production  start.  The 
steady-growth  profile  accounted  for  10  percent  of  the  programs  examined, 
while  the  level-off  profile  accounted  for  27  percent.  These  three 
profiles  appear  to  be  part  of  the  same  family  in  which  cost  growth  rises 
for  a  period  of  time,  then  either  continues  to  rise,  levels  off,  or 
decreases  somewhat.  The  magnitude  of  further  rise  or  fall  was  highly 
variable  across  the  progra.-ns .  The  last  profile,  flat,  accounted  for 
about  20  percent  of  the  programs  examined. 

'■'These  notional  profile.s  emerged  after  examining  eacii  of  the  83 
mature  DE  baseline  programs  separately. 
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nANO#400-4  4-C«A3 


Years  past  FSD  start 


rioure  4.4-Coinmon  Profiles  of  Coat  Growth 


In  practice,  fev.’  programs  follow  these  patterns  exactly.  Rather, 
the  tendency  is  considerable  variance,  as  shown  in  Figure  4.5.  The  B-IB 
is  a  typical  flat  profile,  with  minor  fluotuatj,on  around  the  1.0  cost 
growth  factor  level.  The  F-14A  is  representative  of  a  level-off 
profile,  with  a  minor  fluctuation  occurring  around  a  cost  growth  factor 
greater  than  one.  the  Stinger  is  a  dramatic  example  of  a  turn-down 
profile,  while  the  costs  in  the  AH-64  have  Increased  steadily  over 
time . 


iHputure  research  will  attempt  to  identify  any  fundamental 
technical  or  programmatic  differences  across  programs  that  might  account 
for  the  difference  between  a  flat  profile  and  one  of  the  others. 


34 


Years  past  start  of  engineering  and  manufacturing  development 

Figure  4 . S-ixamplea  of  Actual  Coat  Growth  Prof ilea 

BVXDBNCa  OP  BtrSTBNATXC  BXA8  XN  COBT  BSTXMATXNO 

The  notion  of  estimation  accuracy  is  fundamental  to  a  study  of  cost 
growth.  As  stated  earlier,  cost  growth  analysis  is  interesting  because 
of  the  systematic  bias  in  cost  estimating  and  a  largo  degree  of 
variation  about  the  average. 

Conventional  wisdom  has  held  that  cost  estimates  are  systematically 
biased  (low)  because  of  the  intense  competition  between  new  programs  for 
resources  and  the  competition  tc  win  new  contracts.  Thus,  industry  is 
expected  to  underbid  the  true  cost  of  the  program,  and  the  services  are 
expected  to  accept  such  a  bid  as  reasonable.  However,  little 
quant j  dtive  evidence  has  supported  this  assertion.  Figure  1,1  provided 
evidence  that  cost  estimation  errors,  in  fact,  are  biased  and  the  spread 
of  the  data  is  much  larger  than  we  might  expect  or  desire.  The  cost 
growth  factors  used  to  construct  Figure  1.1,  however,  contain  a  mix  of 
programs  at  each  milestone  (e.g.,  each  baseline).  A  better  indication 
of  estimation  accuracy  would  be  to  plot  the  same  data  for  programs  where 
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we  nave  data  at  each  milestone.  The  results  are  given  in  Table  4.4. 
Although  cnly  five  programs  have  all  three  baseline  estimates,  the 
evidence  strongly  suggests  that  weapon  system  cost  estimates,  as 
reflected  in  SAR  data,  are  systematically  biased  downward,  understating 
final  program  costs.  The  current  database  does  not  allow  us  to  test 
whether  such  a  bias  is  caused  by  underbidding  of  competitive  contracts. 
Also,  the  data  from  these  five  programs  suggest  that  while  the  weighted 
average  cost  growth  decree jes  as  you  move  from  the  PE  baseline  to  the 
later  DB  and  PdE  baselines,  the  variance  increases  significantly  moving 
from  the  PE  to  the  DE. 


Table  4.4 

istimation  Aoouraey  over  Tinei  Seine  rive  Proarema 


Cost  Growth  Factor 

Standard  Deviation 

Planning  estimate 

1.40 

0.276 

Development  OiStimate 

1.32 

0.499 

Production  estimate 

1.09 

0.190 

NOTEi  Weighted  averages.  Programs  include  DDQ-51,  C/MH-53,  M-1, 


Bradley,  and  AH-64. 


36 


S.  FACTOM  AFFSCTXNO  COST  ORONTR 


Thits  section  examines  several  factors  potentially  affecting  cost 
growth  in  weapon  system  programs,  including  development  strategy, 
schedule  related  factors,  performance  goals,  management  complexity,  and 
budget  trends.  While  the  factors  examined  here  certainly  do  not  exhaupt 
the  set  of  potential  factors  we  examined  during  this  study,  they  do 
represent  some  of  the  more  common  and  interesting  hypotheses  concerning 
the  drivers  of  cost  growth. 

DIVSliOPMlNT  STAATBOY 

Development  strategy  refers  to  the  macro-level  approach  used  in 
designing  and  developing  a  weapon  cystem.  We  examined  two  different 
approaches:  prototyping  and  modification  progi'ams. 

Prototyping  encompasses  a  family  of  development  atrategiee 
involving  fabrication  and  test  of  hardware  before  a  production  decision, 
where  the  testing  is  used  to  generate  information  other  than  just 
demonstrating  the  achievement  of  contract  specif ications . Prototypes 
generate  information  that  can  be  used  to  resolve  various  kinds  of 
technical  and  programmatic  risk.  Thus,  we  would  expect  that  programs 
that  included  prototyping  as  part  of  the  development  strategy  would 
incur  less  cost,  growth,  either  because  prototyping  reduced  subsequent 
development  risk,  or  because  the  lessons  of  prototyping  caused  changes 
(e.g.,  cost  increnses)  to  be  incorporated  Into  the  subsequent  estimate. 
Figure  15.1  shows  the  distribution  of  prototype  and  nonprototype  programs 
in  cur  database  by  years  past  EMD  start.  Since  prototypes  are  often 
fabricated  and  tested  relatively  early  in  a  program,  cost  growth  in  les?: 
mature  (younger)  programs  would  be  expected  in  be  somewhat  higher.  As 
improved  Information  becomes  available  earlier,  subsequent  cost 
estimates  can  be  adjusted  accordingly.  The  cost  growth  Co.  mature 
prototyping  programs,  however,  should  be  less  than  nonproi-otyping 

l''cieo  Appendix  f  a  more  complete  definition  of  protc-typiriv-j . 

The  definition  used  here  is  more  completely  documentecl  'n  Jeftroy  A. 
Drezner,  The  Nature  and  Role  of  Prototyping  in  Weapon  System 
De^^elopment ,  RAND,  R-4i61-AqQ,  199:!. 


programs  for  essentially  the  same  reason.  That  result  is  not 
demonstrated  in  Figure  5.1.  In  tact,  no  patterns  emerge  with  respect  to 
prototyping  based  on  these  data . 


Years  past  engineering  and  manufacturing  development  start 

rlguro  5. 1-Dlatrlbutlon  of  Prototyping  and  Nonprototyping  Programs 


Categorizing  prototypes  requires  considerable  information  about  a 
program;  this  information  is  not  always  available.  Thus,  it  is  often 
useful  to  qualify  eacTi  program  designation  as  to  the  quality  of  the  data 
available  and  the  confidence  associated  with  that  judgment.  Table  5.1 
show?  the  v'eighted  average  cost  growth  factors  for  the  set  of  programs 
tiiat  could  he  categorized  as  either  prototyping  or  nonprototyping  and 
also  for  a  subset  of  those  programs  for  which  wo  have  more  confidence  in 
the  categorization.  Using  all  programs  that  could  be  categorized,  we 
see  a  significant  cilfference  between  prototype  and  nonprotatype 
programsi  prototypes  are  associated  with  higher  coot  growth.  Using  the 
smaller  data  set  for  which  we  have  higher  conf iden'.'c  in  the 
classification  does  not  change  either  the  magnitude  or  direction  of  the 


-  - 

difference. Notice  that  in  both  cases  the  effects  of  program  size  and 
maturity  may  be  influencing  the  result.  On  average,  prototyping 
programs  in  our  sample  are  both  smaller  and  more  mature  than 
nonprototyping  programs . 


Table  S.l 

Prototype  Versus  Nenprototype  Progreins 


Cost 

Growth 

Factor 

Number  of 
observations 

Average  Program 
Cost (billions, 
FY90S) 

Average 
Age  (years 
oast  EMD) 

All  programs 

Prototype 

1.26 

52 

4.5 

9.7 

Nonprototype 

1.16 

49 

7.5 

9.1 

Higher  confidence 

Prototype 

1.29 

30 

4.7 

10.7 

Nonprototvoe 

1.19 

30 

8.S 

9.8 

NOTEr  DE  baseline,  weighted  average,  mature  programs. 

The  result  that,  on  average,  prototyping  programs  incur  higher  cost 
growth  is  not  as  counter-intuitive  as  it  first  appears.  For  instance, 
it  may  be  that  the  prototype  programs  are  on  average  more  technically 
challenging,  involving  higher  risk,  and  uncertainty.  Further,  in  many 
cases,  prototyping  might  result  in  an  increase  to  the  current  estimate 
rather  than  the  baseline  estimate.  Using  DB  baselines  as  we  do  here,  we 
would  expect  lower  cost  growth  only  in  programs  that  were  prototyped 
during  a  demonstration/validation  phase,  because  the  resulting 
information  could  be  incorporated  into  the  subsequent  DE  baseline 
estimate  made  at  the  start  of  EMD,  Table  5.2  indicates  that 
programs  in  which  prototyping  occurred  before  EMD  start  have  slightly 
lower  cost  growth,  as  predicted.  An  interesting  side  observation  is 
that  post-EMD  prototyping  Lands  to  be  associated  with  smaller  programs, 
on  average. 

20For  the  current  data  set  (as  of  December  1990  SAR),  this  result 
holds  across  all  weapon  system  types.  The  basic  result  that  prototyping 
programs  incur  higher  cost  growth  on  average  holds  for  both  RDT&E  and 
procurement  cost  growth  across  system  types  as  well.  The  only  exception 
is  that  procurement  cost  growth  for  aircraft  is  the  same  for  both 
prototyping  and  nonprototyping  programs. 
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T«blo  5.2 

Colt  Orowthf  Prototyping,  and  Aoquliltlon  Phaio 


Cost 

Average  Program 

Average  Age 

Growth 

Number  of 

Cost  (billions, 

(years  past 

Factor 

Observations 

FY90S) 

EMD) 

Pre-EMD  Start 

1.23 

28 

6.2 

8.7 

Post-EMD  Start 

1.37 

23 

2.5 

10.8 

NOTE:  DE  baseline,  weighted  average,  mature  programs. 


We  also  compared  modification  programs  with  new  developments.^^  We 
expected  that  modification  programs,  because  of  a  maturity  effect,  would 
incur  less  cost  growth  than  new  developments.  Because  a  modification 
program  is  adding  or  upgrading  one  or  more  subsystems  to  an  existing 
system,  more  information  is  available  to  support  cost  estimates.  Thus, 
the  estimate  should  be  more  accurate.  Table  5.3  demonstrates  that  this 
case  is  in  fact  true.  Modification  programs  tend  to  incur  significantly 
less  cost  growth  than  new  developments.  Program  sir.e  and  age  factors 
ar6  similar  enough  to  not  greatly  affect  this  result. 

Table  5.3 

Modlfieatloas  Venus  New  Programs 

Cost  Average  Program  Average  Age 

Growth  Number  of  Cost  (billions,  (years  past 

_ Factor  Observations _ FY90$ ) _ EMD) _ 

Modification  I.IG  36  4.0  8.9 

New  start _ 1 1 _ 04 _ 6 . 1 _ 9 , 7 _ 

NOTE:  DE  baseline,  weighted  average,  mature  programs. 

8CK1DULB-RBIATBD  FACTORS 

Often  cost  and  scheduJ.e  are  asserted  to  be  highly  correlated  in 
weapon  system  development  programs.  The  relationship  purportedly 
manifests  itself  in  several  dimensions,  including  a  direct  causal 
relationship  in  which  one  drives  the  other  and  in  the  sense  that  a 
similar  set  of  factors  may  affect  both.  We  examined  several  possible 
schedule  factors  as  potential  cost  growth  drivers.  Three  of  the  more 

2lSee  Appe.ndix  D  for  a  listing  of  the  modification  versus  new 
development  classification  and  the  rationale  for  each  program. 
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common  factors  are  discussed  belowi  program  duration,  concurrency,  and 
schedule  slip. 

Sometimes  the  length  of  a  program  is  associated  with  increased 
costs.  The  assertion  is  that  longer  programs  cost  more,  regardless  of 
whether  or  not  technical  or  programmatic  problems  occur.  For  instance, 
a  longer  program  may  include  product  improvements  that  increase  both 
development  and  unit  production  costs.  A  corollary  of  this  assertion  is 
that  longer  programs  allow  more  time  for  unanticipated  events  to  occur 
that  affect  cost  performance.  Figure  5.2  shows  that  such  assertions  at 
least  have  some  merit.  The  figure  plots  the  cost  growth  factors  against 
the  actual  program  duration,  measured  in  months  from  Milestone  1  to 
first  operational  delivery.  The  relationship  is  fairly  strong;  longer 
programs  tend  to  exhibit  higher  cost  growth.  Logically  this  effect  is 
consistent  with  the  maturity  effect  illustrated  previously. 
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Figure  5.2-Coat  Growth  and  Actual  proeran  Duration 
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One  implication  of  this  result  is  the  potential  to  mitigate  cost 
growth  by  design ^.ig  and  executing  shorter  plans.  One  way  may  be  to 
introduce  concurrency  into  the  schedule  plan.  Based  on  the  results 
presented  in  Figure  5.2,  we  might  expect  that  highly  concurrent  programs 
would  have  less  cost  growth  becruse  they  are  shorter.  Conventional 
wisdom  asserts  just  the  opposite.  Because  concurrent  programs 
tran.:jition  into  later  phases  of  development  or  production  without 
necessarily  completing  testing  from  prior  phases,  an  increased  risk  and 
a  greater  potential  exijt  for  cost  growth.  We  measured  concurrency 
several  ways;  one  is  shown  in  Figure  5.3.  In  this  case,  concurrent  iS 
defined  as  the  overlap  (in  months)  between  the  completion  of  lOT&E  and 
Milestone  3a,  the  beginning  of  low  rate  production.  No  strong  pattern 
is  apparent  in  either  direction.  .If  just  the  concurrent  ?-rograms  are 
examined,  however,  .it  does  appear  that  increased  concur.'*ency  and  lower 
cost  growth  are  related.  One  interesting  observation  from  Figure  5.3  is 
that  a  significant  number  of  programs  were  highly  sequential  in  terms  * 
the  timing  of  test  completion  and  the  initial  production  decision. 
However,  the  concurrency  measure  is  highly  sensitive  to  the  iOfSiE  and 
Milestone  3a  dates  listed  in  the  SARs.  A  detailed  examination  of  a  tew 
programs  indicated  that  in  some  cases  i.hose  dates  are  not  renresentative 
of  actual  development  events,  especially  lOT&E  completion.  Thus,  the 
overall  result  presented  here  must  be  treated  with  caution. 

A  .'oinmon  etoertion  is  that  the  same  set  of  factors  affects  Loth 
font.  ,irui  schedule.  If  this  were  the  case,  o  po.sitive  correlation  would 
occur  h'et.v.'een  cost  growth  and  schedule  slip;  we  Would  expect  that  thei’ 
would  move  together.  Figure  5.4  plots  cost  g.rowth  and  schedule  slip, 
mea-sun-'d  as  the  montt.s  of  slip  in  first  operational  delivery,  '''he 


Cost  growth  factor 
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rlgur*  5.3-COft  Growth  vsriui  Concurrsnoy 
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Btrong  positive  correlation  we  expected  is  not  demonstrated.  In  fact, 
no  relationship  at  all  is  seen  between  cost  growth  and  schedule  slip. 
This  result  suggests  that  some  sets  of  factors  can  affect  either  cost  or 
schedule  while  not  affecting  the  other. 

7BRF0IIMAKCB 

Performance  outcomes  are  the  thira  part  of  the  acquisition  outcome 
triad;  often  cost,  schedule,  and  performance  are  used  to  measure  the 
efficiency  of  the  acquisition  process.  The  SARs  contain  a  performance 
section  that  indicates  the  estimated  and  demonstrated  performance  across 
a  r,?nge  of  relevant  performance  indicators  for  each  system.  As 
mentioned  in  Section  2,  we  calculated  a  composite  per.';ormance  ratio 
using  these  datu.  Our  goal  war  to  construct  a  proxy  measure  for 
technical  difficulty.  If  the  ratio  was  less  than  one,  indicating  that 
on  average  the  system's  performance  was  deficient,  we  could  ir.fe;  that 
the  technical  challenge  and  the  resulting  difficultieb  were  high.  This 
information  should  be  associated  v’itii  relatively  higher  cost  growth. 


-  44 


Figure  5.5  ohows  the  result;  no  relationship  exists  between  the 
composite  performance  metric  and  cost  growth.  This  finding  does  not 
mean  that  technical  difficulty  is  unassociated  with  cost  growth. 

Rather,  we  feel  that  the  metric  itself  is  an  insufficient  proxy  for 
technical  difficulty.  Problems  with  the  metric  include  differences  in 
importance  of  the  various  performance  indicators  used  to  calculate  the 
composite  ratio,  differences  in  the  metrics  themselves  (e.g.,  comparing 
unlike  items) ,  and  a  very  small  variance  in  the  composite  ratio. 
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Figure  5.5-Cost  Growth  end  PerfomaDoe  Goals 


KANAOBMSNT  COMPLEXITY 

We  algo  wanted  to  capture  the  complexity  of  program  management  as  a 
potential  factor  affecting  cost  growth.  Management  complexity  might  be 
expected  to  be  associated  with  increased  cost  grov.'th  because  of  the 
coordination  challenges  of  a  large  development  effort.  We  identified 
the  prime  contractor  for  each  program  in  our  database.'*''  Then  we 


‘'^^.‘5ee  Appendix  E  ior  a  listing. 
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compared  those  programs  with  a  single  prime  contractor  to  programs  that 
were  joint  at  the  contractor  level.  Joint  referr  here  to  formal  teaming 
arrangements.  As  shown  in  Table  5.4,  a  substantial  difference  exists, 
however,  not  in  the  expected  direction.  For  this  sample,  the  eight 
jointly  managed  programs  at  the  contractor  level  have  lower  average  cost 
growth  than  singly  managed  programs.  Of  interest  is  that  the  joint 
programs  in  our  database  are  also  smaller  (expect  higher  cost  growth) 
and  less  mature  (expect  lower  cost  growth),  thus  malcing  the  difference 
between  joint  and  single  management  more  8tri)<ing.  Nonetheless,  the 
result  must  be  treated  cautiously  because  of  the  very  smell  sample  of 
joint  programs. 


Table  5.4 

Single  Vereue  Cfoint  Contreetlng 


Cost 

Average  Program 

Average  Age 

Growth 

Number  of 

Cost  (billions. 

(years  past 

Factor 

Observations 

FY90$) 

EMD) 

Bingle 

1.20 

112 

5.5 

9.5 

Joint 

1.11 

8 

4.9 

6.8 

NOTEi  DE  baseline,  weighted  average,  mature  programs. 

BT7D0BT  TRENDS 


Budget  trends  might  be  expected  to  be  associated  with  cost  growth. 
For  instance,  in  times  of  increasing  budgets,  the  expectation  would  be 
that  cost  growth  should  decrease  because  cost  estimates  would  not  need 
to  be  held  down  arbitrarily.  In  other  words,  cost  realism  would 
dominate  in  an  environment  of  increasing  budgets.  The  logic  of  t)iis 
hypothesis  is  that  an  important  factor  in  budget  formulation  in  the 
expectation  of  future  budget  size,  rather  than  the  actual  budget  in  any 
giver  year.  If  future  budget.?  are  expected  to  grow,  and  by  implication 
fully  fund  a  development  and/or  production  effort,  then  cost  estimates 
can  be  more  realistic  and  .still  appear  j'olitically  and  economically 
feasible . 

To  exanine  thi.s  potential  effect,  we  have  plotted  the  average 


Yearly  cost  growth  for  the  set  of  mature  program, s  reporting  in  that 


year^^  and  the  annual  change  in  the  proposed  DoD  total  obligational 
authority  (TOA) .  We  have  lagged  the  TOA  by  two  years;  for  instance,  the 
1982  TOA  was  proposed  in  1980  corresponding  to  the  two-year  POM  cycle  in 
DoD.  Figure  5.6  shows  a  surprisingly  strong  relationship  between 
average  annual  cost  growth  and  expected  top-line  budget  authority. 
However,  the  relationship  is  the  opposite  of  what  we  expected.  In  times 
of  increasing  budgets  cost  growth  also  increases,  while  decreasing 
budgets  are  associated  with  declining  cost  growth  ratios.  The  decline 
may  be  explained  in  part  by  the  strict  cost  controls  managers  impose  in 
times  of  tight  budgets. 


1974  1976  1978  1980  1982  1984  1986  1988 

Year 

NOTE;  TOA  Is  lagged  two  years  to  reflect  budget  cycle. 

Figure  S.E-Xnfluenoe  of  Budget  Expeotatlons 

Note  that  the  cost  growth  line  in  Figure  5.6  shows  that  the  annual 
rate  of  change  in  cost  growth  has  been  negative  in  recent  years.  This 
figure  corresponds  with  DoD  assertions  that  cost  performance  has 

23Note  that  this  metric  is  very  different  for  cost  growth  than  used 
previously;  thus  its  interpretation  must  be  different. 
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improved  as  a  result  of  the  Carlucci  initiatives.  While  the  trend  is 
not  in  dispute,  the  interpretation  is  highly  questionable.  That  trend 
line  does  not  fully  account  for  the  effects  of  maturity,  and  a  different 
mix  of  programs  is  contained  within  each  data  point.  Further,  cost 
performance  is  not  measured  by  the  aggregate  annual  race  of  change  in 
coat  growth  but  rather  by  the  difference  between  the  original  estimate 
and  the  actual  costn,  after  correcting  for  inflation,  quantity,  etc. 
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6 .  COMCliUSZONg 


This  research  had  two  basic  objectives: 

1.  Quantify  the  magnitude  cost  growth  in  weapon  systems 

2.  Search  for  patterns,  trends,  and  relationships  that  might  explain 
cost  growth. 

Thiu  last  section  summarizes  what  we  found  regarding  these  issues, 
and  discusses  some  policy  implications.  Potentially  profitable  areas 
for  future  research  are  also  identified. 

tCOPI  OP  TMI  PROBLIK 

There  are  many  ways  to  measure  cost  growth,  both  in  terms  of  the 
particular  adjustments  made  to  the  raw  data  and  in  terms  of  the  way  the 
data  are  handled  in  subsequent  analysis.  Results  can  differ  as  a 
function  of  these  adjustments. 

We  made  adjustments  to  the  SAR  data  that  removed  the  effects  of 
factors  not  reasonably  attributable  to  the  estimator,  including: 

1.  Using  constant  dollars  in  all  calculations  to  remove  the  effect  of 
inflation 

2.  Normalizing  all  cost  variance  to  the  baseline  estimate  quantity 

3.  Using  only  mature  programs  in  the  analysis,  defined  as  three  or  more 
years  past  EMD  start 

4.  Referencing  all  cost  growth  factors  to  a  specific  baseline,  thus  not 
combining  different  baselines 

5.  Using  weighted  aveiages,  when  appropriate,  to  account  for  the  effect 
of  program  siize. 

Of  these  factors,  inflation  and  quantity  have  the  greatest  effect 
on  reported  cost  growth  outcomes.  Of  interest  is  that  the  two  factors 
that  correlate  with  cost  growth  most  strongly,  after  the  effects  of 
inflation  and  quantity-induced  change  are  removed,  are  program  size  and 
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maturity.  In  general  smaller  programs  tend  to  incur  higher  cost  grov;th, 
perhaps  because  variances  are  proportionately  more  visible,  because 
small  programs  receive  relatively  less  high  level  management  attention, 
or  because  R&D  costs  are  a  large  portion  of  total  costs  and  tend  to 
incur  more  cost  growth.  The  accumulation  of  problems  and  changes  over 
time  is  the  driving  force  behind  the  observed  effect  of  maturity.  It  is 
Important  to  note  that  some  of  these  changes  may  be  product 
improvements.  On  average,  cost  growth  increases  by  2.2  percent  per  year 
above  inflation  because  of  the  effects  of  maturity.  Program  size  and 
maturity  can  dominate  other  factors  affecting  coat  growth  outcomes  and 
so  must  be  considered  in  both  the  analysis  and  the  Intexpretation  of 
results. 

What  is  the  overall  magnitude  of  DoD  cost  growth?  There  is  no 
single  answer  to  this  question;  the  answer  can  vary,  sometimes 
dramatically,  across  tho  factors  listed  above.  For  the  DB  baseline, 
given  the  adjustments  mentioned  above,  the  weighted  average  total 

4 

program  cost  growth  is  about  20  percon'' .  By  way  of  compariaon,  the 
General  Accounting  office  (GAO)  has  reported  41  percent  cost  growth  as 
of  the  December  1987  SAR  submission,  uncorrected  for  inflation  or 
quantity. 

The  Army  and  two  of  its  standard  weapon  tvpe8“-vBhicle8  and 
helic'opters--had  relatively  higher  coat  growth.  This  higher  figure  can 
be  explained  in  part  by  the  generally  smaller  size  of  Army  programs  and 
also  because  Army  programs  on  average  are  about  1.5  years  more  mature 
than  piograma  in  the  other  services. 

A  fundamental  conclusion  of  this  research  is  that  cost  estlinatea 
are,  on  average,  systematically  biased  downward,  resulting  in  cost 
growth,  This  result  is  comparable  with  the  results  of  others.  While 
handling  the  data  differently,  the  GAO  work  cited  above  is  certainly 
consistent  with  the  notion  that  a  systematic  bias  exists  in  cost 
estimation.  Research  by  the  Institute  for  Defense  Analyses  (IDA) 
resulted  in  similar  trends  to  our  current  work:  The  weighted  avvjruge 
total  program  cost  growth  as  of  tho  December  1987  tJAR  submission  was  bl 

^‘'Weapons  Cost;  Ariulysia  of  Major  Weapon  Syatemn  Coat  and  Quantity 
Changea,  GAO/NSIAD-89-32FS,  November  1988, 
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percent,  with  lees  mature  programs  incurring  about  30  percent  cost 
growth  and  completed  programs  incurring  92  percent. 

Work  published  in  1984,  by  Management  Consulting  and  Research,  Inc. 
indicates  an  average  cost  growth  of  18.4  and  18.6  percent  as  of  December 
1982  and  1983,  respectively,  adjusted  for  quantity  and  inflation. 26 

These  examples  illustrate  both  the  variability  of  cost  growth 
outcomes  as  a  function  of  both  the  data  set  used  and  the  way  the  data 
are  handled,  as  well  as  sugge...ing  a  consensus  among  analysts  thac 
weapon  system  costs  are  commonly  underestimated.  A  further  result  that 
we  added  is  that  accuracy  does  not  improve  as  much  as  we  might  hope  as 
we  gain  more  information.  It  seems  that  fundamental  uncertainties 
remain  in  cost  estimation  regardless  of  the  amount  of  information  on 
system  configuration  and  programmatic  information  available  to  the 
estimator. 

The  potential  for  improvement  over  time  is  perhaps  the  issue  of 
most  concern  to  current  policy  makers.  It  seems  reasonable  to  expect 
that  the  myriad  of  initiatives  implemented  over  the  last  several  decades 
intended  to  control  coste  and  improve  coat  estimating  capabilities  would 
nave  had  some  positive  effect.  Unfortunately,  we  can  detect  no  such 
effect  in  the  data.  Cost  growth  has  consistently  averaged  about  20 
percent  over  the  last  few  decades.  Given  the  strength  of  the  maturity 
affect,  however,  it  seams  unreasonable  to  expect  to  measure  such 
improvement  today.  Programs  begun  in  the  19808  will  not  reach  an 
average  age  comparaole  with  our  1960a  and  1970b  data  until  the  middle  of 
the  1990a,  About  70  percent  of  the  programs  we  examined  have  roat 
growth  profiles  that  increase  well  into  production,  Thus,  until  later 
in  this  decade  we  will  not  be  able  to  detect  whether  initiatives 
Implemented  as  a  result  of  the  Packard  Commission  or  the  more  recent 
Defense  Management  Review  (DMR)  have  had  the  desired  effect. 

■■®Karen  W.  Tyson,  et  al.,  .Icquiring  Major  Systems;  Cost  and 
Schedule  Trends  and  Acquisition  Initiative  Effectiveness ,  March  1989, 
Chapter  IV.  IDA'S  cost  growth  results  are  corrected  for  inflation  and 
quantity,  though  the  methodology  differs  from  RAND's. 

^‘'Gerald  K.  McNichols,  et  al..  The  Problem  of  Cost  Growth, 

Management  Consulting  and  Research,  Inc.,  30  April  1964. 
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FACTORB  AFFICVIMO  COST  ORONVH  IN  WIAFON  BYITOX  DBVBLOFIIBNT 

An  important  objective  of  this  research  involved  gaining  insight 
into  the  factors  that  affect  cost  growth  in  weapon  systems.  As 
mentioned  previously,  program  size  and  maturity  can  be'>  ■?( '.  J  >d  as 
important  factors,  but  they  do  not  lead  to  obvious  ’’  .y  ;onses. 
Awareness  of  these  effects  may  change  expectatione  a-i'jt  cost  outcomes, 
but  they  do  not  suggest  direct  ways  to  further  control  the  potential  for 
cost  grov/th.  Thus,  we  examined  several  classes  of  programmatic 
variables,  including  development  strategy  and  schedule  variables,  to 
furtlier  understand  the  drivers  of  cost  growth.  Unfortunately,  we  found 
few  strong  relationships  that  would  help  explain  the  cost  growth 
outcomes  we  have  observed. 

We  compared  the  cost  outcomes  of  prototyping  and  nonprototyping 
programs,  expecting  to  find  that  a  prototype  development  strategy 
contribuLea  Lo  cosl  control  through  reduction  of  uncertainty. 
Interestingly,  programs  that  Included  prototyping  had  a  relatively 
higher  cost  growth.  This  result  may  be  due  in  part  to  the  timing  of  the 
prototype  phase  within  the  context  of  the  overall  program  schedule, 
since  earlier  prototyping  makes  data  available  earlier,  thus  potentially 
affecting  the  baseline  cost  estimate  at  the  time  of  EMD  start.  Our 
ruBults  are  consistent  witn  this  notion,  it  may  also  be  true  that 
prototyping  was  conducted  for  programs  with  relatively  higher  degrees  of 
technical  uncertainty,  a  hypothesis  that  deserves  further  exploration. 

Since  the  information  available  to  an  estimator  for  a  modification 
program  is  greater  than  for  a  new  system  start,  we  would  expect  the  cost 
estimate  to  bs  more  accurate  for  modification  programs.  In  fact,  our 
data  show  that  cost  growth  for  modification  programs  is  significantly 
less  than  for  new  starts,  on  average. 

Aside  from  the  tendency  of  programs  to  accumulate  probloras,  a.nd 
hence  cost  growth  over  time,  the  only  schedule  variable  significantly 
correlated  with  cost,  growth  is  actual  program  duration.  Longer  programs 
tend  to  be  associated  with  higher  coat  growth,  probably  due  to  much  the 
same  mechanism  as  that  driving  the  maturity  effect.  Of  interest  is  that 
planned  length  and  various  measures  of  schedule  slip  arf:  not  related 
syuteniatically  to  cost  growth  outcomes.  While  program  length,  program 
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size,  maturity,  and  modification  versus  new  developments  are  significant 
corr*jlationB,  no  single  factor  explains  a  large  portion  of  the  observed 
variance  in  cost  growth  outcomes.  Hence,  there  is  no  "silver  bullet" 
policy  YOEponse. 

POLICY  IMPLICATXONB 

From  a  policymaking  point,  of  view,  the  fact  that  cost  estimates  are 
systematically  biased  can  be  viewed  positively.  If  the  drivers  of  that 
bias  can  be  discovered,  then  perhaps  policy  options  can  be  formulated 
and  implemented  to  mitigate  the  effects  of  factors  causing  cost  growth 
in  weapon'  systems.  In  contrast,  if  the  drivers  of  cost  growth  were 
random  across  individual  programs,  the  resulting  cost  estimation  error 
could  not  be  controlled  easily.  One  should  also  be  cautious  about 
overemphasizing  a  cost  estimating  bias.  Some  cost  growth  is  caused  by 
continuing  product  improvements  that  cannot  be  identified  early  in  a 
program  and  are  beneficial  to  system  performance. 

Our  research  suggests  that  no  substantial  improvement  has  occurred 
in  average  cost  growth  over  the  last  30  years,  despice  the 
implementation  of  several  initiatives  intended  to  mitigate  cost  growth. 
In  fact,  our  results  suggest  that  cost  growth  has  remained  about  20 
percent  over  this  time  period.  One  implication  is  that  the  various  cost 
control  and  realistic  budgeting  initiatives  have  not  been  fully 
implemented,  or  were  not  implemented  correctly,  due  to  strong 
institutional  barriers.  It  seems  to  us  that  full  and  honest 
implementation  of  existi.ng  regulations  might  improve  the  situation.  Of 
course,  a  rather  major  change  might  be  required  in  the  institutional 
structure  and  incentives  of  the  acquisition  system. 

Is  an  average  20  percent  cost  growth  in  weapon  system  acquisition  a 
problem?  We  feel  that  such  a  judgment  is  Pest  left  to  decisionmakers 
concerned  with  resource  allocation.  We  should  point  out,  however,  that 
the  sum  of  the  total  estimated  costs  for  the  DE  baseline  programs  in  our 
database  is  over  $450  billion  in  FY90  co.nstarit  dollars.  Twenty  percent 
of  that  figure  ($90  billion)  is  .significant  and  could  substantially 
affect  the  quality  of  resource  allocation  decisions,  particularly  in  an 
increasingly  tight  budget  environme.nt . 
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We  have  found  the  SARa  to  be  useful  in  providing  an  overview  of 
cost  growth  outcomes,  though  the  data  for  each  program  must  be  examined 
carefully  for  reasonableness  and  validity.  However,  the  SAR  provides 
limited  data  that  can  explain  the  various  patterns  and  trends  we  have 
observed.  The  performance  data  in  the  SAR,  while  perhaps  providing  a 
reasonable  measure  of  achievement  of  contract  specifications,  do  not 
allow  measurement  of  what  we  are  really  Interested  in*-technological 
difficulty.  The  schedule  and  other  programmatic  data  in  the  SAR  seem  to 
provide  a  reasonable  basis  for  relating  cost  and  schedule  Inputs  and 
outcomes,  but  since  we  cannot  know  the  rationale  behind  those  early 
schedule  decisions,  we  cannot  know  the  extent  to  which  they  actually 
explain  changes  in  cost  outcomes.  Thus,  the  SAR  database  needs  to  be 
supplemented  with  other  sources  of  data  to  support  the  kind  of  model 
building  we  are  attempting  in  this  research. 

Nonetheless,  the  existing  database  can  support  considerable  further 
research.  For  instance,  it  can  be  broken  down  further  into  more 
homogeneous  groups,  such  as  tactical  and  strategic  missiles,  airborne 
and  ground  based  electronics,  etc.  At  that  detailed  level,  it  might  be 
possible  to  identify  relationships  that  did  not  show  up  strongly  in  the 
more  macro  level  analysis  discussed  here.  Additional,  new  explanatory 
variables  can  be  added  that  are  associated  with  hypotheses  not  examined 
here,  such  as  contract  type,  joint  government  management,  single  versus 
dual  source  competition,  production  rate  changes,  and  technical 
complexity. 
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Appendix  A 

STATUS  or  SILICTBD  ACQUISITION  AIPORT  PROORANS 


Table  A.l  lists  the  universe  of  selected  acquisition  report  (SAR) 
programs  and  shows  the  first  and  most  recent  (as  of  December  1990)  SAR 
submission  and  the  current  reporting  status.  The  list  is  divided  into 
active  (currently  reporting)  and  inactive  programs,  It  does  not 
correspond  exactly  with  the  number  and  title  of  SARs  found  in  the 
official  SAR  Summary  lists  because  we  have  handled  certain  programs 
differently  for  analysis.  For  instance,  we  have  maintained  SUBACS  as  a 
single  program,  although  the  Navy  reports  it  in  two  separate  SARs. 

The  16  programs  listed  at  the  end  were  not  included  in  our  analysis 
because  they  did  not  report  costs  in  constant  program  baseyear  dollars. 
Thus,  a  cost  growth  metric  consistent  with  the  methodology  used  here 
could  not  be  constructed  for  these  programs.  Unfortunately,  the  C-5A 
was  included“-a  program  that  has  been  cited  as  having  incurred  high  cost 
growth. 

The  table  provides  the  weapon  system  classification,  explained  more 
thoroughly  in  Appendix  B.  It  also  provides  a  program  status  indicator. 
In  progress  means  that  the  program  is  currently  either  in  development  or 
production  and  is  submitting  a  SAR.  Mature  indicates  that  the  program 
no  longer  reports  SARs  because  Its  production  run  is  at  least  90  percent 
completed.  A  terminated  status  l.ndicates  chat  the  program  was  canceled 
before  completion  for  a  variety  of  reasons,  which  may  include  changes  in 
threat  that  ma)te  the  system  no  longer  necessary,  or  cost,  or  performance 
problems.  A  below-threshold  status  means  that  the  total  program  current 
estimate  is  below  the  SAR  reporting  threshold  and  so  no  longer  submits 
SARs . 

The  table  also  gives  the  total  program  cost  growth  factor  for  each 
program  as  of  December  1990,  or  the  last  available  SAR.  If  a  program 
had  more  than  one  baseline,  each  cost  growth  factor  is  shown. 
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B.  NBAPON  SYSTIN  CtASaiPXCATZOM 

Table  B.l  provides  the  weapon  system  classification  for  each 
program  in  the  database  and  a  brief  rationale  for  that  designation.  In 
most  cases,  determining  system  type  is  straightforward.  However,  in 
some  cases,  we  deviated  from  the  obvious  for  the  reasons  shown. 

The  munitions  category  includes  munitions,  howitzers,  and  gun 
systems.  Munitions  are  distinguished  from  missiles  in  that  they  either 
are  not  self-propelled  or  have  no  guidance  unit.  Missiles  are  self- 
propelled  and  have  a  guidance  unit.  Torpedoes  are  included  in  the 
missile  category.  Vehicles  are  self-propelled;  hence,  trailers  are  not 
vehicles.  Space  .systems  include  both  launch  vehicles  and  satellites, 
Other  includes  rail  garrison  basing,  drones,  UAVs,  rotary  launchers,  and 
SDI .  Electronics  encompasses  all  electronics-based  systems,  including 
avionics,  sonar  and  towed  arrays,  combat,  and  communication  systema. 
Aircraft  programs  whose  primary  motivation  is  electronics  and  that  do 
not  involve  a  new  airframe  are  categorized  as  electronic  systems.  These 
include  P-52  OAS/CMl',  P-3C  mods,  OH-58D,  LAMPS  MK  III,  EF-lllA,  E-3A 
AWACS,  E-4A,  EA-6B  Upgrade,  P-3C,  E-8A  JSTARS,  E-2C,  and  SH-60F  CV  Helo. 
A  similar  logic  is  applied  to  ships  (e.g.,  the  DGL  AAW  Mod  is 
categorized  as  electronics). 

Many  of  the  classifications  are  subjective.  Some  programs  are 
mixture.^  such  as  ttie  Navstar  GPS  ttidt  includes  satellites,  control 
sy.sttmB,  and  user  equipment.  Other  programs  such  as  the  V-22 
(helicopter  rather  tf^an  aircraft)  and  CAPTOR  (munition  rather  than 
missile)  simply  fail  into  gray  areas. 

Note  that  the  table  is  divided  into  active  and  inactive  systems,  as 
in  Table  A, 1 . 
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Tftbl*  B.l 

Weapon  Syatoa  Typo  Claasifloatlon 


Weapon 

Program  Service  Type  Ueucription 


ACTIVE  PROGRAMS  (as  of  December  199u  SAR) 


AAO-U/12  (liANTIRN) 

AF 

Electronic 

Low  Altitude  Navigation  and  Targating  Infrared 
Syatam  for  Night  (EO  fire  control  eystem) 

AGM-131  (SRAM  111 

AF 

Miaeile 

Short  Range  Attack  Misaila  (improved  nucleer 
air-to-iurface  missile  replacing  the  AaM-69A 

AQM-iaiA  (SRAM-T) 

AF 

Missile 

Nuclear  Air  to  Surface 

AGM‘-134  (SICBM) 

AF 

Miaailtt 

Small  ICBM;  hard  mobile  system 

AGM-SSD  (Maverick) 

AF 

Missile 

Imaging  infrared  version  of  Maverick  air-to- 
ground  missile 

AIM-120A  (AMRAAM) 

AF 

Missile 

Advanced  Medium  Range  Alr-to  Air  Miuslle 
(Sparrow  replacement) 

AIM-129A  (ACM) 

AF 

Missile 

Cruise  mlsuile 

B-IB  (Lancer) 

AF 

Aircraft 

Strategic  bomber 

C-17 

AF 

Aircraft 

Transport 

CBU-97D  (Sena  Fused  Weap) 

AF 

Munition 

CDtJ-97/Bi  consists  of  ten  BLU-IOB/B 
submunltions  packaged  within  Tactical  Munition 
Dispenser  (TMD)  (  within  each  BL'J-IOB/B  are  four 
self-forging,  fragment  warheads  commonly  called 
'’BkeecB* 

CELV  (Titan  IV) 

AF 

Space 

Complementary  Expendable  Launch  Vehicle 
(upgraded  Titan  34 D) 

CMU 

AF 

Electronic 

DSCS  III 

AF 

Space 

Defense  Satellite  Communication  System  (secure 
voice  and  high  rate  data  transmission) 

DSP 

AF 

Space 

Defense  Support  Program  (satellite  in 
geostationary  orbit  plus  ground  support 
equipment  for  monitoring  ballistic  missile 
activity  and  provide  warning  of  attack) 

E-3A  (RSXP) 

AF 

Electronic 

Radar  System  Improvement  Program 

F-16  (Falcon) 

AF 

Aircraft 

Multlinission  fighter 

F-22  (ATF,  Advatioud  Tactical 

Fighter) 

AF 

Aircraft 

Air  superiority  fighter 

I  US 

AF' 

filjace 

Inert!. il  Upper  Stage  (upper  stage  tor  Titan 

111  and  Shuttle) 

JSTARS 

Al’’ 

Electronic 

Joint  Surveillance  and  Target  Attack  Radar 
Uyatc.-m  (biittlo  man '-geinenl:  and  targc’t.lng  syBl-om 
\inlng  modi  fled  70'/  lo  he  culled  E-BA) 

ifTtDS 

Ai'" 

EUjct  tonic 

Joint.  Tactical  Information  Distribution 

System  (advanced  jam-reslatant,  cotiiputerized 
radio 

KcMl'jp  (RLratotankurl 

•il' 

Ai  rcraft 

Tanker  aircraft  (modified  KC135A 

Incorporating  now  engines,  pylons,  nacelles) 

Ka-44  (DMSP) 

AF 

Space 

OeferiEo  Meteorological  Satellite  Program 
(Block  OD) 

LiC:M-11HA  ( Peacekc'npurl 

AF 

Mlaaile 

rcBM  (ill so  known  as  MX)  that  Is  currently 

H  i  lo  fyioed 

Navntat  ni','1 

hP 

Sf>iu:n 

Navigation  Satot  ,t.e  Timing  and  R.'inglng 

Global  Position Miq  System 

Pall  Dfirrifion 

AF 

Other 

ITograra  to  enhan,  the  nur vivabi  1 1  t'.y  of  tin; 

ICBM  system  ioy  deidoying  Peacekeepers  on 

1. rains  using  n,it ion's  mainline  rail  network 
(Includes  r rains  .ind  alert,  shelters  for 
t  r  a i ns ) 

WWMCCS  (WIS) 

AF 

Elect,  tonic 

tsorld  Wide  Military  Command  and  Control  System 

AAWS-M  (vLivnlln) 

Army 

Mine  lie 

AriL  1  -  tank  Weapon  Systi  m 
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Table  B.l‘-eontlnu«d 


Program 

Service 

Weapon 

Type 

ADDS 

Amy 

Eloctninle 

AFATD3 

Army 

Electronic 

AOM'IUA  (Hellfira) 

Army 

Missile 

AH-Bil  (Apache) 

Army 

Held. 

AH-66  (Cbmanohe) 

Amy 

Helo 

AEAS/ENSCE 

Army 

Electronic 

ARM 

ATCCQ/CHfi 

Army 

Army 

Vehicle 

Kloctronlc 

EK1M-71C/D  (TOW  I  ,  I 

Army 

MUsUe 

CH-<7D  (Chinook) 

FAAD  cai 

Army 

Army 

Helo 

Electronic 

F'AADS  l,Ofl-F-ll  (ADATfl) 

Army 

MIohI In 

P'AADS  IjOS-B  (Avenger) 

Army 

Missile 

FiWJf)  Niaa  (FOG -Ml 

Army 

MU  j  111! 

FII'IV  (PI.iS) 

Army 

Void  do 

(■'IM  'i/T'  (PI  liKim  KMP) 

Army 

Mind  !o 

FM'IV 

Amy 

Vniudo 

JTMIVATM 

Amty 

hiiiiil  lo 

1  ii ilitiliiiW  A;iiiehe 

/'my 

rcjh it: 

l.iinqlxlW  lie  1  1  1  lie 

Amy 

In 

M'  l  (Ahrf-imiu 

Amy 

Vi-hifU? 

M  2!  1  Itlr.idley  FVi;) 

At  ity 

V'l  '1 1  u  •  1  *  * 

‘  Description 

Army  r>ata  Distribution  Rystem  (hybrid  of  PLRS 
(Position  locating  Reporting  gystaiti)  and  JTI 
Battlefield  Management  and  Derision  support 
Si'BUani 

,  Kellcepter-launched  air-'to-uurface  terminal 
homing  missile  with  variety  of  teeker  modules 
Attack  helicopter  equipped  with  nlpht  and 
adverse  weather  capability 
Helicopter  to  fufill  Army's  armed 
reronnaiesanre/light  atteck  mleslon 
All  Source  ATialysls  Sy ..tem/Enemy  Situation 
Correlation  Element  (A3A3  le  the  control 
subsystem  for  the  tnteUlgerco/PJlodtionic 
Warfare  eubsystem  of  the  Array  Command  anti 
Control  Cyatem 
Armored  System  Modarnlieatiori 
Army  Tactical  Cuminaiid  and  Control  System 
Common  llardwaro/Snftware 

Tube  launched,  Optically  tracked.  Wire  guided 

rurface-to-BurfacB  and  alr-to-iiurfocn  miaul  le 

Medium  transtxirt  hollooptur 

Forward  Area  Air  Defense  Command,  control,  and 

Intelligence;  C2t  network  tylrig  FAAD3  wna[X5ns 

together 

Fotvard  Area  Ah  Dofunse  Syetom  liino  of  Oight- 
Forward-Hcuvy;  ADATH  «  Mr  Defonun  Anti-Tank 
System;  User  Iteamrider  missile;  replacement, 
for  f)gt  York;  mounted  im  Drudluy  Fi/B 
Foiward  Area  Air  Doterme,-  fjyutcm  tine  of  alght- 
Ronr;  aka  "MS  or  Pedestal  Mounted  Stinger;  to 
bo  launched  from  High  Mobility  MuU'.lfiurpoBo 
Whets  led  Vehicle 

Fotvard  Arno  Air  Defenua  Syston  Non-tilnr;  of 
Sight;  P'OQ-M  »  Flbei;  Opt  It;  Guided  MIskIIb;  t.'.i 
Ix!  launctiof]  Irnin  oithor  Mgii  Mtiiilllty 
Mu  1 1 1  ;iu; pone  Vnililclo  t't  MtRS  Vuiildu 
Family  of  llonvy  'I'nctlcal  VohlcloD  (Pul  lot  iun.l 
[.tvidiiig  Svniom);  Ptn  In  Ui.t  ion  vithn'li' 
coratHiood  o|  fit  iim.'  mover  wll  li  inti'grvil  !  t;l  f 
l<>.iil/unl<vii|  fup,-ilji  I  1 1  y  plun  In.'i  ton  t.rnilor 
Mull  iKji  Lubli.',  iiiiouUloi  I  hod  im.lui.'o  to  ii  U 
iTi  i  nu  1 1 1! 

Family  of  Mimllum  'I'rackod  Volilclciii  to  6  ton 
vohic.'on  Huitotl  for  mul t. Ipurtxirui  tr.wiiport 
dfiltil.  Tur.'ticul  MlouJli!  txiroruio  rrot;tum/Aiit,l 
'IVicM'.  I cu I  Mlonllo;  il'IMI)  i  !i  umiirollfi  conr:o|,t. 
under  whJtii  toflmoluulou  to  uppxjrt  uf.'t.lvc 
tlolotiot!,  coutil.iu  I tirco,  ij.i.uiivn  rounl ''tmi'.mui'o 
iiiitl  fiiititi'iintl  tiiu'l  t.'otii  Mil  oy.ii  I'li'ii  iiririionl  Wurri.iw 
PrIOl.  trlCI  icul  mlllllllo  l.hriMl  I  lllitlrll  llJO'llU  l.'l 
on  ;)rovlrllng  ri"ir  tluforisc  of  Pul  rloi  vl.i  Antl- 
'I'.iol  li'ul  Mio.'ii  111  (ATM) 

Pi  to  Coot  ml  Kriiiui 

Ait  1(1  (iroiind 

Four  itii.in,  fili.ihly  imililli’,  hilly  liucki'd  vnliioln 
piilly  ir.P'keil,  1  Iglii  ly  .iiiiioti'd  Iril.mitv  utid 
fill  vary  vchh  le 

Mulli['le  I..'  luTi  Poeki.'l  Syntcliil  uitillotA'  loekitl 
oy.'il.eiti  oh  i-i  2Vi|  luiinoTi  velil..'1o 


M  ;:t  (MI.H.'i) 


Aniiy 


Mull  1 1  ion 
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■rabl*  n.l->oontlau*d 


ProgriOT 

aerviee 

Weapon 

Type 

Description 

M3M-U0A  (ATACMS) 

Army 

Missile 

Army  Tactical  Miasila  System  I  improved 
conventional  miseile  designed  to  attac)c  targets 
beyond  range  ot  cannons  and  roclcecs;  to  lua 
fired  from  MavO  (MLRS)  launcher) 

MIM-;04  (Patriot) 

Amv 

MisBile 

Surface-to-air  missile  that  provides  medium  to 
high  altitude  air  dnfenee 

MLRS/TOW 

Army 

Munition 

Multiple  Launch  Rof,')«et  Syntem/Tenrinf  lly  Guided 
War need 

MSB 

Amv 

Electronic 

Mobile  Subscriber  Equipment i  automatic  twitched 
digital  jecure  voice  end  date  transmission 
for  corps  and  divisicn  users 

OH-'jBO  (AlliPI 

Artrv 

Eluctronic 

Advanced  Helicopter  lmprovomar;t  Program 
(modified  OH-58A  with  TV,  thermal  imaging,  and 
laser  rangefinder-designator  I 

KADARM 

Army 

Munition 

Sense  and  Destroi'  Armor;  munition  to  provide 
enhanced  counterjaattery  capability  for  155mtp 
fifMvltser  and  thu  MLRS 

3INaiARS-V 

Army 

Eloctronic 

Single  Channel  Ciround  and  Airborne  Radio  System 
(VHF-IPM  combat  not  radio) 

UH-fiO  (Blflclihawk) 

Art.iy 

Helo 

Utility  iielicop'-er  formerly  called  ’JT't’AS, 

(Utilitv  Tactical  Transport  Aircraft  Syotem) 

AOM-a0A  (HARM) 

Nu''y 

MiaeiJe 

High  speed  Anti-  ,jtUatlon  Missile;  air-to- 
Butface  mlanlle  designed  to  destroy  enemy 
radars 

At]M/RaM/UaM-84A  (HARPOON) 

Nnvy 

Mlonile 

i.ir/Bhlp/Bubmatine  launched  anti-ship  missile 

AIM-120A  (AMRAAM) 

Nnvy 

Miueile 

Advanced  Madliun  Range  Air-to  Air  Missile 
(Spwrrow  ropldcament) 

A.tM-rv10  (PllOliRiX) 

Navy 

Missile 

Air-to-air,  ail  weather  long  range  missile  with 
improved  perf  and  reliability  over  AIM-S4A 

.AN/ALO-lfjfi  lAfJEVI) 

Navy 

Electronic 

Alrliorne  Self  Protect, ion  Hammer  (defensive  ECM 
for  tactical  aircraft) 

AN/AI'f)-!-!'!  (liAMPfi  MKrd) 

Navy 

Electronic 

Light  Airborne  Multi -purpose  flystem;  computer 
integrated  shlp/hollcoptar  aystem;  the  aircraft 
subsystem  1"  the  SH-60B  SealtawK  (a  derivative 
of  the  l)H-60) 

AN/BHY  l/.'l  (flDHAOri  tximb) 

Navy 

PilnctfonJc 

BUBmarlne  Advanced  Combat  Intcrmation  System; 
AN/BSY-l  for  Loo  AngelcB  cIqdd  attack 
r!U)im,urtnGU  plus  AN/BiiY-Z  for  .''.ouwol  f  tdniitj 
tittack  tiulriinrino 

AN/HiiY  >1  (hdha;;;)) 

Navy 

Electronic: 

.'Itlttrviriin!  Advanced  Combat  Information  Syntem 
lor  Hoawolf  ciaiJC  attack  uubnariiie 

AN/HOg-H'i 

Navy 

Electronic 

Surface  Ship  ASW  Comb<it  system  (provides 
surface  shlpt  with  capability  to  detect, 
classify,  and  track  enomy  subs  at  long  range) 

AiJ/.'igY  1 

Navy 

l''.lcctronlc 

AN/TPr)  VI  (ROTMR) 

Navy 

Electronic 

AOIS  H 

Navy 

fUilp 

East  combat  suppcirt  ship  (delivers  ammo,  tuel, 
and  provisions  to  battle  groups) 

AQM  JV.VA  (HIA'l'l 

N.ivy 

Other 

,‘j»jpf»rHonlc  ln)W  AUiltudo  Taryet,;  rjuptrraonic, 
rnmotoly  controlled,  recoverable  target  vehicle 

AV-HH  (Hrtft  l«r  ID 

Navy 

Aircraft 

Improved  version  ot  AV  BA  V/nTbt,,  light  attack, 
rinse  ,ilr  support  aircraft 

KIM  lOV  |'l'(3m,jli.iwkl 

N.ivy 

MiEjniU.' 

fjliip/uuliiitir  Ini:  hiuticlied  land  attack  and  nntl- 
shlf)  raiaiilln  (formerly  called  HIit'M  or  Boa 
(launched  (.'ruisu  Missile) 

(’/Mil  'ji  IHupin  .'Il.allion) 

Navy 

Hc-lo 

Mhiplxiard  r:ompfirlbln,  heavy  transport 

hel loophHf 

IJtilp  T’lcotidertKja  clauu  iitulsjcr  I  U.f.od  v/l.th  AegiB 
tuimUii  !iynt:i>m 


r:(i  47  t’tuiicr) 


Navy 


Cp6 


T«bl«  8.1-eontinu«d 


Weapon 


Program  . 

Service 

Type 

CVN  'IV,,  73 

Navy 

Ship 

eVN  74,  75 

Navy 

Ship 

CVN -76 

Navy 

Ship 

1500-51 

Navy 

Ship 

E'  2C  (Hawkeyo) 

Navy 

Electronic 

E  bA  Air  Coimi  (lleriiior, ' 

Na‘/y 

Electronic 

EA  fiB  U(.i|r,:ide  M'rowler) 

Navy 

Electronic 

K14D  1','ultic'aL  I 

Navy 

Ai'cralt 

1-7A  lu  (llrrrruitl 

(Kixiirl  l)i  St  r  iiiiit. ion  ; 

Navy 

lyst.om) 

Navy 

Aiicmft 

pi  fSf‘l  f  1  f* 

ncAC-l 

Navy 

Ship 

t,IID-l  (Clas.s) 

Mavi' 

Ship 

I, (in  41  (Criitio  Variant) 

Niivy 

Ship 

MCM-1 

Navy 

•Ship 

Mk-4H  IMx'AH) 

Navy 

Ml.Tlll'! 

MK  'll)  (■I'ORIildtn 

N  ivy 

Miuuilu 

RI.M  r,‘iM,'i7n  (dl'/l'IKI 

Na'/y 

Mi.’ici  Ic 

fill  (lOl'  (CV  11(1  lo) 

N,ivy 

Elect  tonic 

i'l.'iM  ,;l 

Navy 

Ship 

*  .'l(  i. 

;ja'.",' 

.il.iP 

r  -I':; 

tiavv 

Ai  I  I'l  al  1 

'I'An  1H7  ll■'l(||"  miei) 

Na'.'v 

iilllti 

Tiiiii'ir  11  (.itn) 

K.  1  ,y 

SliilJ 

MCM  1  1  lA  I'l't  iiiel"  i  1  1 

Iv  I'.Y 

Minsi 'e 

I'HK  Kill  ifiW  nil 

fill'.",' 

,'i|.ioe 

V  .l.i  Inapt  e'l'i 

1  i.  I'-Y 

lli-l'i 

;:i;;i/iii'A!.:: 

o::i) 

Ol  llr-i 

iriAiM'l  ,|.  ll.iiil'AM.i 

i'  i'  A  (,^'|■.■<|  l;er  .  I'l  .1  111 

.  )  Ai  * 

,‘(i  1  I'l  ,il  I 

Al-' 


Deocription 

Nimita  claSD  nuclear  powered  coniera 

Nlmltz  data  nuclear  powered  carriers 

Nuclear  Alrcrafr  Carrier 

B’’  ke  class  guided  missile  destroyer 

Corrier-basod  early  warning,  strike  control  and 

aurvoillanco  aircraft 

Basic  E  3  aircraft  to  replace  PXT-i.lOQ  tor 
providing  reliable  and  secure  communications 
from  National  Command  Authority  to  Fleet 
Ballistic  Missile  ^Submarines 
Imprcvfid  capability  electronic  countermeasure:, 
for  EA  SB 

Carrier  based  air  dnfrjnse  fighter;  ban  new 
nnglno,  new  digital  avioniCD  and  upgraded  radar 
Car'-ler  iw'ind,  muU  i -m.'sHtnn  tafB.lcal  alt'-'rafr 

Fixrd  iJlDtrib'it  l.on  Gyrtem;  puncive  ncouutic 
Bun'cil lance  oystem  for  detracting  nubs 
handiiig  craft  Air  CUfihion;  provider  silip-to- 
shore  f  ranapfjrtrtt ion  n,:  men  and  equit)ment 
Wasp  classi  .•unphibiouB  assault  ship  (designed  to 
land  Marino  force&i 

Variant  of  LGD  'll  mtslified  with  nmallcr  dockit)g 
wo  11  (to  Qccommodato  more  trorjpii  and 
etiuii»r-.'r.t )  and  hnavlor-diity  cranes 
Averigrar  class  Mine  Countermoauures  Gh'.p 
Arriltlonal  CAPnbiUty,  nubr>.irlhn- launclicil, 
conventional,  wire  guided,  ijcoustlc  liomlng 
torpedo  (tntxl  to  bri'ilc  MK-plB) 

Advanced  i,igntWolglh,  'I’crptido;  uhli- or  (Uicraft 
liiu;ii:liod  anti  siileiiir  1  no  wi.ajxHi  rystolti 
Chin  1,-iunchotl  tmrfi:ii;r!  tr)’al, r  mli)Mll>j;  MU  ■ 
Hoiiinm  Bango  and  I(R  =  lixtended  Range 
Rrovldea  carrier  inner  tone  AflW  protection 
uni.o'i  an  improvoii  t-etlioreii  ronar;  ti’idiiinui 
.'111  'll 

Gc.'iwpdt  clit'UJ  ol  niu'lrar  poWi''ri.'d  ati.iii'',< 
riulin.1'  ini' 

..u:;  Ariele.i  i  iaai,  ^it  liUi  li‘iit  (rt'Wi’li'd  ,a  !  ack 
r'liinat  me 

'I'laining  nyn' em  i.'nnu  i'  'I'lA  irli.iwk  Immli  I  ied 
vnrninn  n|  I'ritiiil,  Aeroripacc  Hawk) 

•lAo  lSV  cl,.r,n  llci'-  oiler 
Ohio  claMs  Tr  idi.-nl.  1'.  ritrotcgic  inintiilc 
ai,lin.iM Mini  (at.iti  inci  with  ;"'I'N  /''ll 
llnlin.irire  l.iirii'hcd  Uil'.  ictic  mlnniU; 

CHI'  Kill  low  On  riiiiiiiii,n i Kill  imi  rl  1  ii  e  nyr' cm 
Mi,|;  imirciiiii  Vert -.1  ,il  lakenll  iiinl  landlna 
.ijii'ii-|.  |iii  aiiimMii'  iriniiiiH  ,  in'ateh,  ,md 

relU'U,, 

Mix  'll  H"  nil 


'ri.ii'iing  .nn't.il'  l"i  i'I'i'  i,ika  t.'i'.<i  oi'iii'irit  imi 
Ttaliiei  or  Mil!') 

■'lime  ,,  I  r  I'l)  I  ml  I  111  1 11  a  1 1 

f'l.:'e,.ii  c.irpiil.  iind  i  111  I  Mil  el  n  111  .ntei.iC. 


A  1"  |■!'li'ln.lle;ll;l 
A  Ml  I'  ■'  a  :■  1  I  111 


,1 1 1 1  I  ,il  I 
Al  1  I'l  ,it  I 
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Table  ^.i-oontiaued 


Progrant 

Service 

Weapon 

Type 

Diiscrlption 

AC3M-6!iA  (Mavariek  TV) 

AP 

Miaaile 

TV-gulded  alr'to-aurface  missile 

AGM-65C  (Maverlclt  Laser) 

Ai' 

Micelle 

Laser -guided  air-to-surface  missile 

AOM-69A  (SRAM) 

AP 

Miiaile 

Short  Range  Attack  Missilet  supersonic  air-to- 
surface  missile  armed  wltli  nuclear  warhead 

AGM-S6B  (ALCM) 

AP 

Miealle 

Mr-Launched  Cruise  Mlosl'i.e 

AOM-SSA  (HARM) 

AP 

Missile 

High  Boeed  Anti -Radiation  Missils;  air-to- 
surface  missile  designed  to  destroy  enemy 
radars 

AOM'136A  (Tacit  Rainbow) 

AF 

Missile 

Air-launched,  loitering,  antiradiation  missile 

AIM-7M  (Sparrow) 

AP 

Missile 

.Ml  weather,  air-to-air  missile 

A,rM-9L  (Pidawinder) 

AF 

Missile 

Infrared  seeking,  air-to-air  missile 

A1M-9M  (Sidewinder) 

AF 

Missile 

Infrared  seeking,  air-to-air  missile 

AN/PP3-118  (OTH-B) 

AF 

Electronic 

Over-the-Horison  Basckscdtter  Radar 

ASM-135A  (ASAT) 

AT 

Hiaaile 

Anti-SATallite  missile)  modified  SRAM  first 
stage  plus  Altair  III  second  stage 
with  miniature  imaging  infrared  homing  warhead 
vehicle 

ATAR3 

AP 

Electronic 

Advanced  Tactical  Air  Reconnaissance  System; 
focuses  on  development  of  common  systems  for 
manned  and  unmanned  reconnaissance  family  of 
EO/IR  sensor  suites,  datalink  sets,  recorders, 
and  recon  management 

a-lA  (Bomber) 

AF 

Aircraft 

Strategic  bomber 

B-52  (OAS/CM:,  Stratofort.) 

.AP 

Electronic 

Offensive  Avionics  System/Cruise  Missile  (iVLCM) 
Integration 

OQM“109a  (OLCM,  Gryphon) 

AF 

Missile 

Mobile  surfaca-to-surfacB  intermediate  range 
nuclear  missile)  aka  GLCM  or  Ground  Launched 
Cruise  Missile 

C-5B  (Galaxy) 

AF 

Aircraft 

Transport  aircraft  (improved  version  of  C-5A) 

CIS  (MARK  XV  IFF) 

AF 

Electronic 

Combat  Identification  System  (Identification 
Friend  or  Foe) 

CERr. 

AF 

Other 

Commot.  Strategic  Ro'cary  Launcher 

EI-jA  (AWACS,  Sentiy) 

AF 

Electronic 

Airborne  Warning  and  Control  System;  modi  tied 
707  aj.rCrame 

IS- 4  (AABNCP  NEIACP) 

AI'- 

Elect»'onic 

Advanced  Airborne  Command  Rost;  modified  747 

EF-lllA  (TJS  Ravon) 

AF 

bllectrotilc 

Tactical  Ja)iiming  Sy-'^tem;  modified  P'-li''A 
alrfr.ime 

F  l'i  (Rariln 

AF 

Aircraft 

Air  superiority  flgfitnr 

F-)ll  A/D/F  P' 

AF 

Aircraft 

Tact. leal  tiglit.er 

!■'  '.iK  I'l’iqni  11.) 

AF 

Aircraft 

Air  ouperiority  tiqtif.or 

lIH  finiJ  (NiuliV.  Il.iw)<) 

AF 

Hr.!  1 1 ) 

Coiiil)at.  search  and  rencuc/spccial  operat.'orui 
hel  Icop'.or 

t-flA  (Al'IPR) 

AP' 

Electronic 

Inter-ServlcG/Agoncy  Automatod  Messogo 
I’rocesslng  Excliar.ge 

JTIDr,  ( (injianct'd  tllH) 

Al'' 

Electronic 

High  aiitl-.1am  riaoist.ant.  voice  commutucaf ion 
syjtein 

Ki:  lOA  (ISxtrjncler) 

AF 

Aircraft 

Tanker/cargo  aircraft  (modified  IXf  10) 

1.1^0(71'  Bomb  GuLdarK:(7 

AP' 

Electronic 

liow  t,eve)  liriBer  Bonili  Guidance  Kit  (a)<a  I'aveway 
Jri);  conn  Into  of  latter  Iximl^  guidance  kit 
attached  to  MK-n:!  (GBU-ilZ)  or  MK-H4  (nnu  2‘,) 
Ixxiib 

UlM  (Mlriut.eman  tU) 

AP' 

Mlnai  1'! 

Three  stage,  solid  tiropellant  K’HM 

MU; 

Al'' 

El  or; k.  roil 

Mlctowavo  Landing  Hystom  (prechilon  apin-oac)i 
radar) 

t’LSG 

AP' 

Electronic 

Precision  Locat  ing  Htrlke  Plystems 
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Table  B.l-oontlnuad 


Program 

Service 

Weapon 

Type 

Description 

UXC-4  (TRl-TAC) 

AF 

Electronic 

Joint  Tactical  Communications  Program  (tactical 

AQH-136A  (JGLTacitRnbw) 

Amy 

Mlseile 

multi-channel  switched  communications  including 

AM/TRr-17Q  digital  tropscoplc  radio  terminals 

and  the  Communications  Nodal  Control  Element 

(CNCB) )  1 

Joint  Service  Munition  ' 

AN/CSa-10  (TACFIRE) 

Amv 

Electronic 

TACtical  FIRE  direction  System  (integrated  on- 

AN,'TTC-39 

Amy 

Electronic 

line  tactical  computer  system  for  use  by 
field  artillery  units) 

Circuit  switch 

AN/USQ-84  (SOTAS) 

Army 

Electronic 

Standoff  Target  Acquisition  System;  consists 

ARVS  (Scout) 

Army 

Vehicle 

of  airborne  surveillarce  and  target  acquisition 
radar  (mounted  in  EH-60C)  plus  datfilink  to 
ground 

Armed  Peconnaissance  Vehicle 

BGM'VIA  (TOW) 

Army 

Miasile 

Tjl3e  launched,  Optically  trac)(ed,  Wire  guided 

PGM-77A  (Dragon) 

Army 

Missile 

surfacn-to-HurfacB  and  alr-to-surtace  mloslle 

Medium  :..ange,  wire  guided  Antitan)<  missile 

FIM'92A/B  (Stingar/Stlnger-Post) 

Army 

Miscile 

Mon  portable,  shoulder  fired  surface-  to-air 

1 

HLH 

Army 

Holo 

missile  in  disiposable  launch  tube 

Heavy  Lift  Helicopter 

JTIDS 

Army 

Electronic 

Joint  Tactical  information  Distribution  System 

lAV 

Army 

Vehicle 

Light  Armored  Vehicle 

14-luy  (Howltaor) 

Army 

Munition 

Self  propelled  howitzer 

M'19B  (Med.  Tow  Howltaer) 

Army 

Munition 

155irm  Medium  Towed  Howitzer 

(4-60A2  Tunlt 

Army 

Vehicle 

Diesel  powered  comlvit  tan)( 

M'V12  (Copperhead) 

Army 

Munition 

Cannon  launched  ISBmm  guided  projectile  (homes 

M-9H8  (DtVAD  .Sqt  Yorl<) 

Arm/ 

Munition 

on  laser  beam  projected  on  target  ty  forward 
observer) 

DlVloion  Air  Dofenne  gun  Bystum;  cordolnos  twin 

MaN-13lB  (Pershing  ll) 

Army 

Missile 

40fflm  guns  with  sophisticated  fire  control 
system;  chaDols  to  have  been  modified  M4a5  tanl< 

Mobile,  Intoimediato  range  ballistic  mlsBlle 

I4C)M1)0  (I„jnce) 

Army 

Missile 

with  nuclear  warhead 

MtM-U'j  (Roland) 

Army 

Missile 

Short  range  surface  to-alr  missile  wli.ii  vehicle 

MIM  (  linjit  ovi.'ii  ll.iwk) 

Army 

Misnl  1<! 

mounted  fire  unit;  Europea.n-designed 

Medium  rnrige  nir  dflHnsn  mlri.';lli'  acjalnru  Iciw  l.o 

Rl'V 

Army 

Oldier 

lM■■dlum  .nit  it' ado  ,-jin'riift 

A-iullij;  smull  propullor  ilrlvon,  aiil.oituil.  lea  1 1  y 

Pafi.Kfiiurd 

Army 

Missile 

Cl  ,1  It  rolled  pilotlcuii  altctalL  to;  l.tuguL 
acquisition,  detilgriatJori,  rnconna Isaance,  and 

Hamagp  .--issnuMmont 

0"  projectiles  Cl•.lpflblfl  tit  i.irgot  liiflttin 

ii"  cluidtxi  Pin  it'd.  1  le 

Nijvy 

Miiri  1 1 1  on 

after  launcfi 

Sprint  and  the  high  til  1 1 1  uile  f;p,jrt'’m 

Ijoinl  active  Inner  quldeti  prnlect.  lie 

H"  Ctuidpf!  F’ru  lpr;h  i  1 1? 

Nnvy 

Munition 

F.imlly  of  gun  laiinciied  t.ennlnal  liomiug  il" 

A  (jE/F  (tnf, ruder) 

NiJVy 

Aircraft. 

pro.)oci  1  lt!s 

Carrier  baaed  att.aclt  aircratt  (rihtp  a;id  land 

A  Vp:  (Cntfl.lK  II) 

Niivy 

A  ire.  raft 

targets) 

Ciirtler  Ij,uici1  clom;  ,i  1 1  .'lupport  ami 

Aeqin  MIt  7 

Navy 

Electronic 

lritA‘rilU;i  Ion  ti Uctiin. 

Antl-*:>lr  tlufonne?  uyntom  utjinq  nilVtiniMvi  oorujopt 

A(IM  ‘j.IA  ICondot] 

Niivy 

Mlssl  le 

radar  nytu  cm  atitl  anneii  wllh  ilt.indrud  inlnnlle 
lil.andofl,  ait  to  ■  silt  face,  l-IO  guided  mlnrille 

AIM  ‘jIA  U'hoenlx) 

Navy 

Missile 

Air  to  ,ilr,  all  weather  long  range  missile 

AIM  7M  (ufjtirrdw) 

Navy 

Mlssl  le 

All  air-ho  air  iniiniiUi 
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Weapon 


Program 

Service 

Type 

Description 

AIM-9L  (Sidewinder) 

Navy 

Miasilv 

Infrared  ueelcing,  air-to-air  niSBile 

A1M-9M  (Sidewinder) 

Navy 

Ml  sslle 

Infrared  seeltlng,  air-to-air  missile 

AN/SQR-19  (TACTAS) 

Navy 

Electronic 

TACticai  Towed  Array  Sensor 

A3WSOW  (Seu  Lance) 

Navy 

Missile 

uuM-DJSAi  Anti -Sulanarine  Warfare  Standoff 

Weapon)  SOBROC  replacement 

Battleship  React. 

Navy 

Ship 

Reactivation  uf  battleships  New  Jersey,  Iowa, 
Missouri,  and  Wisconsin 

t:SN-38 

Navy 

Ship 

Virginia  clnaa  nuclear  powered  guided  mleslie 
crulaar 

CVN  68,  69,  70 

Navy 

.Ship 

Nimlcr  clasu  nuclear  pov/ered  carriera 

CVN  71 

Navy 

ship 

Nlmite  class  nuclsar  powered  carrier 

DD-963  (DeKtroyer) 

Navy 

Ship 

Spruancc  class  destroyer 

F-:4A/n/C  (Tomcat) 

Navy 

Aircraft 

Carrier  iDaand  air  defense  fighter 

FPtl-7  (lOlaae) 

Navy 

Ship 

Oliver  Perry  class  guided  missile  frigate 

UFAJ  .System 

Navy 

Electronic 

High  Frequency  Anti-Jam  System/  program  to 
acquire  HF/AJ  communication  system  to  noot 

Battle  Group  and  tactical  support  needs 

iJTlDS  DTDMA 

Navy 

EiectroiiJc 

Joint  Tactical  Information  Distribution 
Syatem/Distrlbuted  Time  Division  MultipJo 

Access 

IjHA  (Aaeault  Ship) 

Navy 

ship 

Tarawa  class  ajnphiblouo  assault  ship  (deploys 
Marines  by  both  helicopter  and  landing  craft) 

Light  Amored  Vehicle 

Navy 

Vehicle 

Marine  version  of  Army  LAV 

LSD-41  (Basic) 

Navy 

ship 

W)iidbey  Island  class  larid.1ng  ship  dock; 
provides  transportation  and  launching  of 
amphibious  craft  with  their  crews  and  oiriherkim 
poreonrol 

MK-IO  (Phalanx  C.IWS) 

Navy 

Munition 

Close  In  Weapon  System;  automatically 
controlled  gun  system  dc.slqned  to  provide 
defense  isgal net  close  In  fie,i  sklinmlrig 

MK  4H  (TOUPEDO) 

Navy 

Missile 

fj'ubnarine  launched,  long  rrinqe,  )ili;l-i  spend 
•ncoustlc  homing  Lorptiilo 

MK-60  (Capt.or) 

Navy 

Munition 

enCAPsulated  VCjRpodo;  mine  consisting  of 
■sncapsulatnd  MK-46  torpoiio 

NATO  AAWH 

Navy 

Ot.her 

Anti  Air  Warfare  System;  NATO  col  labimtlvo 
developmerit  oncompnoslnq  dptoctlon  through 
oiigagement  c'apeibif ity,  optimised  t:o  mpHt  thn 
alil.l  liliip  r:ruii:i!  iniiinlle  ihrn.il  ;  pi  uviili'ii  Ini' 
i l;l.l•l;^lr  1  on  ,nul  coin  ml  ol  ,1  Imo Iml  l.ir  [H.'n.'Kuiii 

11  lilii.il.iim  exiiiinii  loll,  iiiiil  Inl  oqt  ,jl.  ion  nC 
li.jnlklll  and  nulT.kill  engaaemnnt  reuourceii 

NA'IU  I’ilM  (llycjralol  1  I 

tifivy 

Ship 

Pegatius  class  patrol  cnmb,ihant.  ■missiln 
(liViln)loi  1) 

r  .ic:  (orliiii) 

Navy 

Klectrimlc 

I„rncl  Ijiiseri  anl.lsubiii.ir  I  no  pal. ml  .ilrcrafl. 

1'  i('  Mi)(l  (c)r  Inn) 

Navy 

Ulncl.t'jiiii- 

Avlonlcii  iifrliitotl  ut  P  IC 

!■  7A  (I.WAACA) 

Ni.ivy 

Alrcrafl. 

Long  Mange  Air  ASW  Capiibllil.y  Alti  frifl. 

S' (A  (Viltlng) 

Navy 

Alrf;ra(r. 

Carrier  iMsod  art.l -iiulimarliit;  [vii  inl  ,ilri:rafi. 

,siJH'rA;i,s 

Navy 

I'.'li’Cl  roil  In 

I'llHvnI  1  lance  lowed  Array  "ennor  .'iyiil  i.in 

Tficinni,  1  (;llin) 

Navy 

.all  1)1 

ohlt)  chin.n  Trident.  I'  nl  lal  eq  ir  mliniil.e 
.uuljmijrlrie.n  ((.IfiTtN- Vlir,  i.tini  VIJ) 

UfJM  '.'LA  CI'I  hlnriL  I  1 

Nav/ 

M  i  s.'i  1 )  c! 

ilillxivirlrie  launched  ha  1 1  i  111.  1  c  inlnsile 

VA.'IT 

Navy 

Klf'r'l  rnlilt; 

Vernal.  1  le  Avionlen  Phop  Tent.  i'r(ul[iment. 

INACTtVK  PMCXlim'; 

NOT  roi,i,|.;(.'TFiJ 

1  niiK  'IX) 

AiviNNCi':  01''  ma::I':  ykah  da'I’a 

c  'lA  (ti.il.ixyl 

AF 

Ai t  oral  1 

Tr  arinport.  a  l  rc  r,l  1 1 

i)5!c.'::  1 1 

AF 

.'I{j,ice 

Ujfciiiie  ll.itelllte  t 'eiiimun  1  cat.  i  tin  .'lyMi.r!iii  (neciit 
Viilce  and  linih  r.ite  ilal.n  l.rniinmi  nn  Ion) 

IJI-lllA  llinliiliet) 

AF 

AI  tct.d  1 

Metiinm  range  ulral.egh'  )« uniter 

Tabl*  B. 

1-contlnuod 

Service 

Weapon 

IVTf 

Description 

1/GM-30F  (Miriut  ■imrin  II) 

AF 

Hiss lie 

Three  stage,  solid  propellant  ICEM 

AH -36  (rhcyrjnne) 

Anny 

Helo 

Attac!;  helicopter 

i«mr-5<Kaoi 

Army 

Veiilcle 

Main  Battle  Tanlc  (formerly  MBT-70) 

MOM- 51  (Shillelagh) 

Ar.v 

Missile 

Tank- fired,  IR-galded,  Dptlo-.lly'tracked  anti¬ 

AM/DOO-'J 

No>/'y 

Flecr.rornc 

tank  nihsile  ' 

2<jnar  for  nuclear  attack  sutmarines 

AN/BOS -11  ISIA 

Navy 

Electronic 

Sutmarine  search  sonar,  actlve/|?a£".iive 

N/SOT-2J 

Navy 

Electrv'iic 

Sonar  for  patrol  ships 

AV-»A  (Harrier) 

I'lavy 

Aircraft 

V/.3'f01,.  light  attack,  close  air  support 

jK  1.;52  (KacfiiM 

Navy 

Shill 

oircra'-t 

Knox  1 'asj  escort  (now  reclassified  as 

(ii/r-  AAw  'Ii-kI 

Navy 

Electronic 

t ligates) 

Guided  Missile  Frigate  Anti-Air  Warfare 

r;  (:;!  arqocir.l 

Na'/y 

Oiip 

Modernization  (to  improve  effectiveness  of 
electronicB  and  missile  system) 

Ilturgeon  clans  nuclear  attack  sulmarine 

SSN-hHb 

Navy 

Ship 

l.ipscomb  clans  nuclear  attack  subniaririo 

(IGH-73A  C'osojdon  C  3) 

Navy 

Mi SK i  Irt 

.-^ubitiai  lno  launched  ballistic  Kiissile 

C.  PROTOTYPE  DB8X0NATX0N 


Classification  of  6  program  as  to  whether  or  not  it  was  prototyped 
is  inherently  diftirult.  The  information  required  to  make  that 
assessment  is  often  not  available,  and  the  available  information  is 
often  ambiguous.  We  have  adopted  a  uroad  definition  of  prototyping, 
developed  as  part  of  other  RANU  research.  The  basic  definition  used 
here  i-s  given  below: 

A  i^rototype  is  a  distinct  product  (hardware  or  software)  that 
allows  hands-on  testing  in  a  realistic  environment.  In  scope 
and  scale,  it  repj'esents  a  concept,  subsystem,  or  production 
at  tide  with  pot.ential  utility.  It  is  built  to  improve  the 
qu.jlity  of  decisions,  not  merely  to  demonstrate  satisf actioi'. 
of  r^orittact  specifications.  It.  is  fabricated  in  the 
expectation  of  change,  and  is  oriented  towards  providing 
information  afti.;cting  risk  management  decisions.'’^ 

Based  on  trie  amount,  relevence,  and  quality  of  informat. ion 
available,  we  hu''e  also  rated  our  confidence  in  our  prototyping 
de.s  ignnt  i  on :  high  confidence  implies  that  the  information  we  had 
avaiLiide  wu.s  enoufjh  tor  in;  to  unambiquuunly  apply  our  definit.ion.  The 
source  of  information  is  indicat'.cd  .is  wo !  1 . 

A  related  notion  in  that  of  fjrecedent:  was  there  proviou.n 
expt.' r  i  enci';  wit.ii  t.hii;  uyni  cm  t.ypc  ,iiul/oi  I  cctino  1  oqy ,  find  it  no,  what  tyiie 
U.L  expijiicnco.  Geiieiuily,  the  nuiiio  infotmaLion  juqijijcd  t  oi  m.rkinu  l.iR' 

pi  1  )t  <  ,1  yp  1  ri'I  di i  fitl.  U  i  I  >11  will  nuppe  u  I  .i  ■  Id  , . ,  in  j  ti. 1 1  i  nn  ,  1  |  .i  c.  'c,  I,  .nl  . 

riic;,-  c.'ii  Pc  no  pi'cccd.  n;  ( <■ .  n  .  ,  l-'  I'.A),  '.liicci  pu  "i  ot  ype  (VP  lu  l,. 

P  Ic),  iii'iir.ct  pi  cii  (.  .t  yi  ic  (XV  ! '■  I  o  V  .Hi),  oi  pt  cv  i  on  n  iii'idcln,  (H  lA  to 
P  11').  .Illy  I  1  ic  : ;  c;  ■(  j|  I'  1  . 1  Ml  1  I  1 1  ;  1  1  i  f'.l  t  c'lo  |  j ,  .  1 1  , .  [ ,  i  ( ,1  <  il  y  p,  ■ :  :  I  1  |c  1  i  |  ; ,  1 

,n  ,1  r  •.  ,t!c,  .nt'  j  rjii.i !  di  VC  P  imi'iit  mn  .i.t,  .irid  flu  touitti  in,  ,i 

'd  i  1  i  c,  I  '  ,  ,  .11  p  I  c'i  I  ,1111  . 


.  '  •  :  I  1  cy  A 
p.\-cic/ 


c.U.cl  ,  /C'/C  ,  I,'  ,  1'  pp  ;  ;;i  i\'iMp[i/J 

I'U’mPP,  1  ‘1  1  c.l  ■  ACpl  ,  1  I'Cp 
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D.  MODirXCATXON  DlflXOMA'rxON 

Table  D.l  indicates  whether  the  program  is  a  modification  of  an 
existing  program  or  a  new  program  start.  The  determination  was  made  in 
part  based  on  information  used  to  make  the  prior  experience  assessment 
in  Table  C.l.  Modifications  include  major  subsystem  upgrades, 
replacements,  add-ons,  life  extension  programs,  etc.  Modification 
programs  often  can  be  identified  by  mission  and/or  capability  changes  to 
existing  systems  and  are  sometimes  associated  with  a  change  in 
designation  (e.g.,  “A*  version  to  "C"  version).  tJondevelopment  item 
(NDI)  programs  are  considered  modifications. 


-  79 


T«bl«  S.l 

Nodlflaation  D««l0nation 


Prooram 

Service 

Weapon 

1  Type 

Mod? 

Comnente,  etc. 

A-10  (Thunderbolt) 

AP 

Aircraft 

no 

Built  from  scratch 

A-7C  icoraalr  ii) 

AF 

Aircraft 

yw 

Earlier  \-Tb  (Navy  varsiont) 

AAQ-n/ia  (LAimRN) 

AF 

Electron 

no 

No  precedent 

AOM-13XA  (SRAM  III 

AP 

Mipaile 

yai 

AOM-lllA  (SRAM-T) 

AF 

MiBsile 

yea 

ACM-114  (SICBM) 

AF 

Mlaslle 

no 

No  precedent 

AQM-lltiA  (Tacit  Rainbow) 

AF 

Miaalle 

no 

No  precedent 

A£»i-65A  (Maverie)<  TV) 

AF 

Mifsile 

no 

Original  vara ion 

AOM-65C  (Mavericit  Laaer) 

AF 

Misalle 

yea 

Saalter  mod 

>vJM-65D  (Mavericit) 

AF 

Missile 

yas 

Seelter  mod 

ACM-69A  (SRAM) 

AF 

Missile 

ro 

AOM-e6B  (AlQ!) 

AP 

Mieslle 

no 

No  precedent 

AiiM-88A  (HARM) 

AF 

Mloeile 

no 

AIM-120A  (AMRAAM) 

AP 

Missile 

no 

No  precedent 

AIM*129A  (ACM) 

AF 

Missile 

no 

A1M-7M  (Sparrow) 

AP 

Missile 

yes 

Earlier  Sparrows  (*F*,  “L"  veraiona) 

AIM-SL  (Sidewinder) 

AF 

Missile 

yes 

Earlier  versions 

AIM-9M  (Sidewinder) 

AF 

Missile 

yea 

Earlier  versions 

ANi'i'PS-lia  (OTH-B) 

AF 

Electron 

no 

No  precedent 

ASM-135A  (ASAT) 

AP 

Missile 

no 

No  precedent 

ATARS 

AF 

Electron 

no 

No  precedent 

B-IA  (Bomber) 

AF 

Aircraft 

r»o 

New  development 

B-lB  ( Lancer) 

AF 

Aircraft 

yea 

Upgrade  of  B-IA 

B-52  (OAS/CMI,  Stratofort) 

AF 

Electron 

yes 

AvionicB  upgrade 

BGM-t09O  (dLCM,  Gryphon) 

AF 

Mieslle 

yes 

ACLM/SLCM  derivative 

C-i7 

AP 

Aircraft 

no 

New  development 

C-5B  (Galaxy) 

AP 

Aircraft 

yes 

Based  on  C-SA 

CBU-97B  (Sens  Fuzed  Weap) 

AF 

Munition 

no 

CELV  (Titan  IV) 

AF 

Space 

yes 

Earlier  Titan  systems 

CIS  (MARK  XV  IFF) 

AF 

Electron 

no 

New  technology 

CMU 

AF 

Electronic 

yes 

CSRL 

AF 

Other 

no 

New  u.ie/'new  tech 

DSCS  til 

AF 

Space 

no 

Unique  satelite  systems 

DSP 

AF 

Space 

no 

Unique  satelite  systems 

E-3A  (AWACS,  Sentry) 

AF 

Electron 

no 

New  development 

E-3A  (RSIP) 

AF 

Electronic 

yen 

E- 1  (AABNCr  NEACP] 

AH' 

lU  ectron 

no 

N>3W  ac  (Boeing  747)  with  new 
ulectronics 

EF-lUA  (Ruvenl 

AF 

E)  octron 

yea 

MiB.elon/avloriicB  change 

F-111  A/D/E/P 

AF 

Aircraft 

no 

Original  vr^rslon  was  new 

F-15  (Eacjle) 

AF 

Aircraft 

no 

Original  version  was  new 

F-16  (Falcon) 

AF 

Aircraft 

no 

Original  version  was  new 

F - 2 2  ( A'i’F , Advanced  Tactical 

Fighter)  A!' 

Ai  rcratt 

no 

New  teclinology 

F-5E  (Tiger  ID 

AF 

Aircraft 

yes 

HH-60D  (Might  Hawlc) 

A1‘' 

Helo 

yes 

UH-60  derivative 

T,-SA  (AMPE) 

AF 

Electron 

no 

lUS 

Al'' 

Space 

no 

Neni  booster  devolopmeru. 

JSTARS 

!»!>' 

Electron 

no 

No  precedent 

JT1D3 

AF' 

Electron 

no 

No  precedent 

JTIDS  (Enhanced  FdS) 

AF 

Electron 

yoH 

Basic  JTIDS  TDMA 

KC-lOA  ( Extender  1 

Al'' 

Aircraft 

no 

Does  not  count  mcxl  of  DC-10  to 
miULiuy  configuration 

KC-13DR  (SLral.otanItet ) 

AF' 

Aircraft 

yes 

New  engine 

Ka-44  ([3MSP) 

AF' 

Si)tir;e 

Mo 

Unique  natelltH  syatettis 

laser  Bomb  Guidance 

AH' 

P.lectron 

V'es 

This  Is  3rd  gene'-atlon  nf  kit 

UlM-llBA  (Peacekeeper) 

AT 

Mian)  le 

no 

No  precedent 

LGM  )0a  (Mlnuteman  III) 

AF 

Mlaailn 

yes 
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Weapon 


Program 

Service  Type 

Mod? 

Commerits,  etc. 

MLS 

AP 

Electron 

yes 

Fart  carniercial ,  part  new 
development 

Navstar  OPS  (Sat.) 

AF 

Space 

no 

No  precedent 

Navetar  OPS  (U.E.) 

AF 

Electronic 

no 

PLSS 

AF 

Electron 

no 

Rail  aarr.'"on 

AF 

Ocher 

no 

No  precedent 

T-46A  (Next  Gener.  Train.) 

AF 

Aircraft 

no 

UXC-4  (TRI-TAC) 

AF 

Electron 

no 

wwMCc:.  (wis) 

AP 

Electron 

y«a 

Modernization  program 

AAWS-M  (Javolln) 

Amy 

Miaflile 

no 

ADDS 

Amy 

Electron 

no 

APATDS 

Artty 

Electronic 

no 

AOM-114A  (Hellfire) 

Army 

Mianile 

no 

AGM-lieA  (JQLTacitRnbw) 

Amy 

Miaaile 

yes 

AtI-64  (^che) 

Amy 

Helo 

no 

AH* 66  (Coiranolie) 

Amy 

Halo 

no 

AN/G.'IQ-IO  (TACriRE) 

Army 

Electron 

no 

New  development 

AN/T'lC-39 

Amy 

Electron 

no 

See  TRI-TAC 

AM/USO-84  (SOTAS) 

Amy 

Electron 

no 

ARVS  (Scout) 

Amy 

Vehicle 

no 

New  development 

ASA5/BNSCE 

Army 

Electron 

no 

No  precedent 

ASM 

Amy 

Vehicle 

no 

ATCCS/CHS 

Amy 

Electron 

no 

No  precedent 

BQM-TIA  (TOW) 

Amy 

Missile 

no 

BOM-71CVD  (TOW  11) 

Amy 

Mlanila 

yes 

CH-47D  (Chinoo)t) 

Amy 

Helo 

yes 

FAAD  C21 

Amy 

Electron 

no 

FAADS  L03-F-H  (ADATS) 

At.iy 

Missile 

no 

FAADS  LOS-R  (Avenger) 

Amy 

Missile 

yes 

New  a  plication  of  Itaelc  Stinger 
missile 

FAADS  NLOS  (FOO-M) 

Amy 

Misailu 

no 

Firs'-  application  of  FOO-M 

POM-77A  (Dragon) 

Army 

Mlosilo 

no 

New  uevelopment 

FHTV  (PLS) 

Army 

Vehicle 

no 

Now  ay  •'tern  deaign/configuration 

PIM-92A/B  (Stlnger/Stinger-PoBt ) 

Amy 

Missile 

no 

FIM-92C  (Dtlngor-RMP) 

Amy 

Missile 

yes 

FMTV 

Amy 

Vehicle 

nc 

HLH 

Amy 

Helo 

link 

JTIDS 

Ar.Ty 

Electron 

no 

JTMD/ATM 

Amy 

Mlofulo 

no 

IJ\V 

Army 

Vch  1 1;  1  c 

no 

LorigbwApachr! 

Army 

fcDcctrcmir: 

yoM 

Longbwilltlro 

Army 

Mloailc 

you 

M-1  (AlirnmB) 

Army 

Vehicle 

no 

M-in9  (Howlt/nr  1‘iS) 

Army 

Muni  Lion 

no 

New  dovi.lopment 

M']7t3  (Mod.  Tow  Mowltaier) 

Army 

Munition 

no 

Devolopnd  £rom  acratch 

M-2/J  (Bradley  FVS) 

Army 

Vehiclo 

no 

M-2i;  (MUL'D 

Amy 

Munition 

no 

K  (lOAZ  Tan)? 

Amy 

Vehiclo 

yen 

M  712  (Coppot head) 

Amy 

Muni  t.  Ion 

no 

M  ')««  iniVAD  Syl,  Yoil?) 

Amy 

Mun. ( Ion 

no 

NXjM  rUlt  il'einliiny  It) 

Amy 

MIkoIIo 

yon 

MtlM  HOA  (ATAGM;!) 

Amy 

Mi  nil  lie 

no 

No  pi  i'cedent 

M(i"  'll!  (l.iinnel 

Amy 

Mlnnl  Ifj 

no 

MIM  104  (P.it  riut  1 

Amy 

lUa.-il  1(! 

no 

MIM  11'.  (nnl,in.il 

Army 

Mlnsii  In 

you 

.'-'yr.l  i;in  doulgri  w.3!j  imrKirlud  with 
fioint;  mcxl i f  ic.it, loti 

MIM  2iB  (  liii()r(ivml  ll,iwl?l 

Amy 

Mi:i;u  lu 

y.*B 

MI.,li;:/Tr)W 

Amy 

Mutiil  ion 

no 

Mill!: 

Ariiy 

Kli'ft  run 

yt?n 

1  .D I  r  ‘f.Htimc  r  c  i  a  1  tieve  1  oj jmunt 
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Weapon 


ProgroiTi 

Service 

Mcs57 

Comments,  etc. 

011*580  (ah:p) 

Artry 

Electron 

yea 

OH-58A/C 

RPV 

Amy 

Other 

no 

SADARM 

Amy 

Munition 

no 

Safeguard 

Amy 

Missile 

no 

S1NCX1AR3-V 

Amy 

Electron 

no 

ltH-60  (BlflCkhawlc) 

Amy 

Hide 

no 

5*  Guided  Projectile 

Navy 

Munition 

yea 

Similar  to  Copperhead 

8*  Guided  Projectile 

Navy 

Munition 

yea 

Based  on  S  In  OP 

A-6E/F  (Intruder) 

Navy 

Aircraft 

yea 

Earlier  version 

A-7E  (Coroair  II) 

Navy 

Aircraft 

yea 

Earlier  version 

Aegis  M)t  7 

Navy 

Electron 

no 

AGM*53A  (Condor) 

Navy 

Mlaeile 

no 

AOM-88A  (HARM) 

Navy 

MisBlle 

no 

AaM/RQM/UOM-94A  (HARPOON) 

Navy 

Missile 

no 

AIM-120A  (AMRAAM) 

Navy 

Missile 

no 

AIM-54A  (Phoenix) 

Navy 

Missile 

no 

AIM-54C  (Phoenix) 

Navy 

Missile 

yea 

Earlier  version 

AIM*7M  (Sparrow) 

Navy 

Missile 

yes 

Earlier  version 

A1M-9L  iSidewlndat) 

Navy 

Misslla 

yea 

Earlier  version 

AIM-9M  (Sidewinder) 

Navy 

Missile 

yea 

AN/AIjQ-ieS  (ASPJ) 

Navy 

Electron 

no 

AN/APn*la4  (MMP3  MKIII) 

Navy 

Electron 

yea 

UH-60  mod 

AN/e8Y*l/2  (8UBACS  comb) 

Navy 

Electron 

no 

Original  program  was  new  development 

AN/SOQ-B?  (/.EWC3) 

Navy 

Electron 

yea 

Integration  of  subsystama  developed 
separately 

AN/(?QR-).9  (TACTAS) 

Navy 

Electron 

no 

AN/SOR-19 

AN/SQY-1 

Navy 

Electronic 

yea 

AN/TP'J-Vl  (ROTHR) 

Navy 

Electronic 

no 

AOE'C 

Na-,y 

Ship 

no 

AQM-laVA  (SUAT) 

Navy 

other 

no 

Af'WSOW  (Sen  Lance) 

Navy 

Mlaello 

no 

AV-HB  (Hairier  ID 

Navy 

Aircraft 

yea 

Earlier  version 

Britt lenhip  React., 

Navy 

Ship 

yes 

BOM*! 09  (TomahawK) 

Navy 

Missile 

yes 

ALCM  niortlticatlon 

r/Mll-53  (.sutler  .St-alllon) 

Navy 

Helo 

no 

00-47  (Ac  ,ii)  Cru.l.-'ii,,'-) 

Navy 

Ship 

no 

New  class 

CXtN-.)8 

Navy 

Ship 

no 

New  class 

CVN  f)H,  69,  70 

Navy 

Ship 

no 

New  class 

CVN  71 

Navy 

.Ship 

yvB 

Follow- on  ships  in  claas  viith 
changes  in  Bystems 

CVN  12,  7) 

Navy 

S)iip 

yos 

Fnl low-on  Hhips  in  class  with 
ctiunijes  in  systems 

CVN  74,  75 

Navy 

Ship 

yes 

Follow  on  ships  in  class  with 
changes  in  systems 

CVN- 76 

Navy 

.ship 

yes 

DlJ-96.)  (lleHtroyur) 

Navy 

Ship 

no 

New  class 

DDU-51 

Nairy 

Ship 

no 

New  class; 

13  2C  lllawlteye) 

Navy 

Election 

yt'S 

E-6  Alt  Comm  (llumii’H) 

Navy 

Electton 

no 

t3A-f)B  lltxirflrfi.  ("rowlojrl 

N.  iw 

Fllort  ron 

yes 

F'  14A  (Tomcat) 

Nrjvy 

Alrrrott 

no 

F-14n  (Tomcul  ) 

Navy 

Aircraft 

ytT 

I'VA  IH  ( Hot  nut  1 

Navy 

Alrcralt. 

r») 

l''lj;!  (Kixf'fi  111  Ml  r  1  hut  ion  .'lyai  om) 

Navy 

Mh’ci  roll 

yen 

Commorclftl  uynt.em  conversion 

^'l■tl  7 

Navy 

Shi|i 

no 

Now  class 

Hl'AI  Hytit  >im 

Navy 

F; loci'  roll 

IK) 

.iTtU'i  irriWA 

Navy 

Eloctrori 

no 

Technology  dllfers  from  basic  JTIDS 

ICAC  1 

Navy 

.Ship 

no 

tllA  (Ai'Uiiull  ,.'tii(j) 

N  iv>/ 

Ship 

nij 

Now  cl.'isn 

Now  cli'iBn 
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Prooram 

Weapon 
Service  Type 

Mad? 

Cemnents,  etc. 

LHD-1 

Navy 

Ship 

no 

New  class 

Light  Armored  Vehicle 

Navy 

Vehicle 

no 

LSD-41  (Basic) 

Navy 

Ship 

no 

New  class 

r.3D-41  (Cargo  Variant) 

Navy 

Ship 

yea 

MCM-1 

Navy 

S'iip 

no 

New  class  | 

MK-15  (Phalanx  CIWS) 

Navy 

Munition 

no 

New  concept  (gun  slaved  to  radar) 

MK-48  (ADCAP) 

Navy 

Missile 

yes 

MK-48  (TORPEDO) 

Navy 

Missile 

no 

MK-50  (TORPEDO) 

Navy 

Missile 

no 

(4K-60  (Captor) 

Navy 

Munition 

no 

EnCAPsulated  M)t“46  TORpedoi  new 
concept 

MATO  AAWS 

Navy 

Other 

no 

New  development 

NATO  PHM  (Hydrofoil) 

Navy 

Ship 

no 

P-3C  (Orion) 

Navy 

Electron 

yes 

P-3C  Mod  (Orion) 

Navy 

Electron 

yea 

P-7A  (LRAACA) 

Navy 

Aircraft 

no 

RIM-66M,S7d  (MF/ER) 

Navj/ 

Miaaile 

yes 

R1M-67C  )Dased  on  Std  Msl  1 

S-lA  (Vil«lng) 

Navy 

Aircraft 

no 

New  development 

SH-60F  (CVHELO) 

Navy 

Electron 

yoB 

Added  coin)oat  system  to  SH-60B 

SSN-21 

Navy 

Ship 

no 

ssN-esa 

Navy 

Ship 

no 

5URTASS 

Navy 

Fleet ron 

no 

Mobile  30SUS 

T-45/TS 

Navy 

Aircraft 

yoB 

Modified  BAe  Haw)< 

TA0-1B7  (Fleet  Oiier) 

Navy 

Ship 

no 

Trident  I  (SUB) 

Navy 

Ship 

no 

New  class 

Trident  11  (SUB) 

Navy 

Ship 

no 

New  class 

UaM-133A  (Tridont  II) 

Navy 

Missile 

no 

New  development 

UaM-96A  (Trident  I) 

Navy 

Missile 

no 

New  development 

UHP  Follow-on 

Navy 

Space 

no 

New  generation  communication  set. 

V-22  (Osprey) 

Navy 

Helo 

no 

New  type 

VAST 

Navy 

Electron 

no 

New  development 

SUS/QPALS 

OSD 

Other 

no 
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